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j  NOTE 

I  Ttii.  took  Is  deTDtod  to  the  piobll eniB  of  cyboi*- 

I  netlcs.  It  diEcusses  the  lavfs  governing  the  pi’OcesBj-ng 
j  of  j^nforTiiatiori  and  control,  in  living  onganlsraB.^  Mi  ex- 
i  position  is  presented  ot  exj^eriJi’ental  investigations 

j  that  have  detected  al gorithans  at,  the  -basis  of  the 

I  •' 

I  brain* B  functioning  as  a  highly  developed  eslf'^org'a.- 

i  ■  .  ■ 

I  iE,lng  systeKo 
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The  eimulatlon  Hiethod  was  used  foi»  study  of  prob«» 
lens  of  nein»ocybemetlos* 

The  book  is  'directed  to  Boientlfic' workers  In  the 
fields  of  physiology,  pathophysiology,  uiedioins,  an.cl 
technical  cybernetics  and  allied  areas «  It  sssay  be  of 
interest  to  a  wide  circle  of  readers  interested  in  cy¬ 


bernetics. 


XMODtJCTION 


Cybernetics  is  concerned,  with  Study  of  two  basic 
Gategorl.es  of  systems?'  iaan,-made  radlo-electranic  ays- 
terss'  (cybernetic  machines)  and  systems  which  exist  in 
nature  and*  have  appeared  in  the  process  of  evolution¬ 
ary  development  of  the  organic  universa  (living  organ¬ 
isms  ) , 

In  these  t'wo  categories  of  systems  'we  can  detect 
a  certain  definite  coMion  group  of  qualltati've  rela¬ 
tionships  and  phenomena  related  to  the  processing  of 
information  and  control!  these  result  from  tlis  func¬ 
tioning  of  cosi^lsx  systems  ooiiBistlng  of  a  large  num¬ 
ber  of  elements  which  are  Interconnected  arid  Influence 
one  another  in  special  ways. 

The  occurrence  of  these  coiEmon  qiialitative  rela¬ 
tionships  does  not,  of  cotifse,  mean  that  It  is  posBi- 


;  tie  to  reduce  the  lav^e  of  ooeratlon  of  the  brain  to 

k 

I 

I  those  cf  a  machtne. 
i 

!  The  appr-oaches  to  study  of  the  two  categories 

)  ■  '  ■  ■  ' 

I  ll.nod  here  must  differ  In  accordance  vt'itli  tl'Kitr  nature g» 
I  In  studying  cybernetic  fliachine?:^^  ffian  is  dealing 

i  ■  •  .  ■ 

i  with  creatlcns  of  h;uS  own  handS;»  and  he  obtalne-,  as  a 
I  result,  broad  cpport’unlties  for  analyttaal  st,uxil.y  of 
I  the  laws  of  operation  of  these  systems*  The  escperijnenter 

I  can  resolve  those  systems  and  their  sections  Into  tlieir 

t 

!  sep-Trate  ecmporients  and  study  the  sections  In  ieolation.-, 

i 

i  he  can  sti’dy  the  operation  of  the  separate  elements  of 
'  which  these  cybernetie  systems  are  composed. 

f  Investigation  of  the  systems  of  Diving  organisms 

I  ■  ' 

,  cool  not  admit  cf  these  methods  cf  arislyslSo  Moreover, 

!  , 

ii  th.9  systems  opera tl-ig  in  living  organisms  and  the  prin- 
clplefl  and  mechanlsi^ir.  that  are  manifested  are  so  coisv- 

j  pie,;.,  tha!:.  it  has  b.iej.  Impossible  to  this  day  to  eimu. . 

i  late  them  with  M-^chtues* 
i 

Ihe  study  of  these  phenomena,  is  of  gres,t  intereBt 
i  for  cybernetics* 

P 

i  ■  ■  '  ■ 

This  gives  rise  to  the  special  nature-  of  studies 

\ 

s  of  living  organisms,  and  that  of  the  brain  In  parti- 

i 

I  eular*  T!::iese  inveetigations  emhrace  two  elcsely- r-elaited 


problems* 
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a)  Stiidies  of  the  'bi'aln  bs:*lng  to  light  Im*-  J 

"  i 

5i 

pos^tant  tl^or^tloal  relationships  governing  the  opera-  f 

tlon  of  coTfiplex  control  sjsteme,  and  these  majr  be  of  . 

great  significance  for  the  dereloptient  of  theoretical  | 

.cybernetics,  Qcialitative'  laws  and  phenos^na  dieco-vered  j 

i 

in  study  of  the  brain *s  operation  may  be  of  use  in  the  § 

’i 

creation  of  new  cybernetic  'inachlnes,  -  | 

■  I 

b)  The  second  problem  relates  to  the  use  of  the  j 

gchieveiflents  of  cybernetics  for  study  of  the  physio-  | 

logical  i>rocessea  at  the  basis  of  tlje  brain^s  opemtlon,  I 
The  study  of  the  general  relationshd.ps  and  principles 

I  ■  ‘  , 

in  tlis  fimctioning  of  systems  y^hlch  has  been  based  on 
the  creation  and  analysis  of  radio -electronic  Bsodels 
(cybernetic  machines)  may  be  of  slgnj.f loanee  for  the 
study  of  vital  problems  of  physiology,  Fi’om.  this  m  go 

■  I 

on  to  discover  rjew  possibilities  for  study  of.  the  com-  .j 
piex  forms  of  lnfox‘mation  processing  in  the  various  dl- 
visions  of  the  nervous  system.,  which,  needless  to  say, 
is  of  great  interest  for  tliB  solution  of  a  nurAwsr  of 
pressing  biological  and  medical  problems „ 

Thus,  a  specific  array  of  problems  related  to 

study  of  tho  brain  defines  itself.  It  differs  to  a 

■ 

significant  degree  from  both  technical  cybsrnetio.s  and 

the  problems .of  recent  physiological  investigations, 

„  _ _ .,,,  ,  - — . . 

■  . . . . . . .  . 
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j  v?lth  reppeot  to  both  the  natiii^  of  tlie  problema  in-  I 

i  '  - '  j 

I  tierant  to  this  field  and  the  epeoifics  of  tlrje  wethoda  i 

t  .  . 

i  of  investlge-tlon  used.  It  is  thlE  that  has  fit;:rn;lBhed 

}  '  '  f 

{  tl’ie  basis  for  the  resolution  of  neurocybernetics  m  a  I 

I  ? 

I  specific  field  of  studio  ^ 

i  ‘There  nc  longer  exists  any  doubt  that  cybei’netios  i 

['  ^ 

I  rjicy  prove  of  great  value  for  physiology.  HowevaiVf  the  | 

?  concrete  aspects  of  the  reciprocal  relationship  between  ! 

i  ■  ’  'I 

cyber2ietica  and'  pl'iyelology'  rerain  unclear  in  mny  re-  ?; 

spects*  i 

I  '  1 

Although  the  present . volume  does  not  pretend  to  I 

o^'rar  a  solution  to  these  pressing  and  complex  prob-  | 

I  .  i 

I  lews,  it  does  attempt  to  indicate  soma  of  the  posal-  | 


■‘iS'llities,  using  as  examples  a  series  of  problems  which 
arise  In  study  of  the  brain, 

■The  work  which  »e  thus  submit  for  the  reader*® 

(  v-'ention  la  not  a  oeflnitlve  work  l.n  the  field  of 
nerr-ocybernetics  and  majces  no  pretense  to  exhaustive 
exposition  of  the  essence  of  the  problemB  being  at¬ 
tacked  by  this  science.  It  Is  merely  an  attesipt  to 
mark  out  ways  to  tlie  solution  of  certain  problemiS 
which  arise  in  this  direction. 


i 

i 

i 

i 

f 

> 

i 

f 

I 

I 

i 

\ 

j 

i; 

j 


The  problem  to  which  this  study  la  devoted  is  a 
new  ouj.  The  natural  result  is  that  many  of  tl'^e  ques- 
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tions  in  tlie  book  are  offered,  as  rnaterd-al  for  dls-cus- 
Sion  and  In  the  hope  that  farther  consideration  will 
result  in  refinement  or  even  In  essential  changes  in 
the  -d-ewpoints  which  we  advance^ 

Xt  is.  our  pleasm-^e  to  ©.xpress  our  pr-o.fo-urid  grati¬ 
tude  to  Acadeiflician  k^J.^  Berg.,  Professor-  E»  Ya?  Kolhnan^ 
and  Professor  V,  S*  Novikov  for  nitmero’us  instance .s  of 
valuable  counsel  which  were  o.DSer’i-'ed  In  writing  the  booko 


CHAFIER  I 

CY^SHNSTICS  AND  HffSIOLCXJY 

a)  The  Ob^lect  Of  Investigation 
:m,  Wiener  /23/  ha.0  defined  cy  borne  tics  ss  tine  : 
science  concerned  with  proceB-seB  of  oont:eol  and  .corn-' 
j^jnicsation  in  living  organissis  and  waohines. 

A  certain  tendency  toward  expanaiori  of  the  con¬ 
tent  of  the  te.rm  ”cy'rerri.etlc-s”  as  given  by  Wi.ener  has 
rc'cently  Ixsen  noted.  In  partl-oular-j,  it  has  been  empha¬ 
sised  /52^  59/  ths.t  eybeivietios  is  related  to  stiidie.s 
of  l8;ws  of  Infor-mtion  processing  in  various  ByB- 
perns.  A. A,  jCyap'onov  /kq/  Indicates  in  his  theoretical 
paper  that : the  has Id  problem  which  has  given  rise  to 
the  appearance*  of  cyberne tics  is  that  of  mutual  ■  re-la— 

!  tioRShlps  between  the  capabilities  of  computing  mchinei 
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land  the  thought,  pi-’ocess.^  while  tlie  haslc  method  la  that 
I  o.f  algorlthmc  deacrlptioR  of  the  operation  of  control 
;  systema^  W,  Ross  Ashby  /6C/  aeeerts  that  cybernetics 

i  .  , 

5  raay,  in  facti  be  defined  as  the  study  of  complex  sys- 

i-  '  -  '  .  '  ■ 

i  tei-Jn  He  considers  that  the  difficulties  obstructing 

I  tlio  st'ady  of  a  whoZ  o  aeries  of ,  scientific  probleits  in 

j  tl'ie  field  of  phystcd ogj.r— among  which- he  Bpeolfically 
\ 

i  includes  study  of  the,  pbiysiology  of  the  bra3.n>— -result 
■from  the  fact  that  the  investigator  encounter b  the  ex- 
istence-  and  operation  of  extremely  complex  syetems* 

I  Tac  methods  used  until  now  to  study  these  system-s  have 
'  i'jiot  rjiade  it  possible  to  obtain  oomple'ce  analyses  of 
■  ■bhf'i.r  operatlono 

.  In  the  opinion  of  Ashby  /CO/,  science  has,  during 

*  the  last  two  centuries,  studied  the  most  complex  sye- 

(  ■ 

I  toms  of  Interx'elatcc)  phenomena,  e.xi sting  in  iiature  on 

s'.' 

t  tr,:  .orinciplo  of  "u,u!.*ving  one  factor  at  a  time" 

^  ■  - 
I  Using  special  experimtental  techniques,.'  the  most  ■■■  , 

I  complex  Bystems  of  phenomena  .have  been  artlfioially  '  ■ 

f  '  ■ 

I  disriiemborcd  l,nto  their  component  parts -‘-'into  simpler 

i  ■ 

I  elementary  processes- — y?hich  have  been -studied  in  iBo~ 

•  lation,  independently  of  one  another.  We  know,  for 


I  exariiple^  that  to  study  the  highly  complex  systems  of 

i  ..  .  ■  '  '  -  , 

I  chemical  processes  w’hioh  unfold  In  an  organism  It  be--* 


i  coKSB  n.eoefiS£.t*y  to  sever  Individt^al  chemical  reactions  . 

I  from  tile  ovcjr-all  eye  tern,  by  one.iaethod  or  another,  Tneee 


I  reactions  are  then  studied  In  isolation  in  test  tubes 
^  imder  iireoise  experimental  conditions',  Thertaf  ter^^  all  I 

i  '  -  ■  ■'  ■  _  -  ■  ,  I 

!  the  experlHsentai  data  outlined  In  dlffei»ent  experiments  | 

I  and  by  different  investigators  aee  added  together  and  ^ 

I  the  result  used  as  a  basis  for  construction  of  an  ov4r^“  I 

I  all  picture  of  the  chaiidcal  prooess  taking  place  In  che  I 

I  ■ '  .  ^ 

I  organism,  :  \ 

Ashby  believes  that  this  approach  is  .  Justified  only  | 

in  study  of  simple  systems  of  phenomena.  It  ljeco'.!if^s  in-  .  | 

I 

applicable^  however,  when  we  pass  to  study  of  complex  ^ 

isy  Sterna,  ‘  | 

Haw  phanpme.na  and  interrelationships  which  it  is  I 

I  imj>oss?,ble  to  study  by  analyBls  of  tbelx*^  sisrolest  com"*  | 

I  ^>onents  arise  in  complex  systeiftS,  This  situation,  which  | 

is  dii’tiotay  i*elatc-d  to  one  of  the  basic  tenets  of  dia-  '  j 
lectio  Biateriallsm  (the  transition  from  quantity  to 
quality)  rmy  be  illustrated  with  the  aid  of  the  com¬ 
puting  maohi.ne  &&  an  exas^le.  Not  one  of  the  i^nsnts 
of  vihloh  the  computer  consistB  1©  possessed  of  the  re¬ 
markable  properties  which  tiiB  'entire  system  poaseBses 

I  as  a  whole  (tte  capability  to  perform  complex  oalcula- 

t  ■  '  „  ' 

I  tlons,  translate  from  one  language  to  another,  play 


i  obos.s,4  etc«U  All  these  properties  are  found  to  be  ir)~ 
j  hei'ent  only  to  the  cornplex  system  fcrmod.  by  tl.ie  e3.emen,ti:i; 
i  wlien  tliey  are  combined  in  a  &peoia3  manner  to  the 

i  cyternetic  iritichlno)  to  form  an  integrated  whole.  The 

j:  ■ 

;  sane  relationship  Is  observed,  in  study  of  phyeioloelooi 

‘  procesoee,  e,£,j  in  study  of  the  functioning  of  the 

\; 

I  bialn,,  TliO  bral.n  represents  a  aonplex  system  of  inter- 

J 

;  related  nervous  eler:ic.nts.  The  lri.d5.,vldual  n&rvo^  cells 


pcBSess  relatively  almpde  prcperties^  They  may  )x>  either 
j  In  a.  state  of  excitation  or  in  one  of  inhlliltlon.  They 
\  can  either  transmit  a  stlmul.ation  immu]  se  or  not  trans- 

i  . 

;  ii:U,  It.  ilie  reraarkabio  properties  of  the  brain  (thougldh 

I 

j  jn,9ginatlon,  memory,  etc.)  arise  only  in  the  oonple.x. 


’ystem,B  formed  by  elements  which  are  related  to  on;: 


\  anocher  in  a  special  mianner.  Thus  the  study  o.f  Indi'/ld- 

i' 

I  ral  nerve  elements  o-"  individual  groups  of  nerve  ele- 


t  La  sic 


cannot  p:rcvide  ..-e  with  axi  imderstandlng  of  tlie 
principles  of  the  brain’s  operation  or  the  basl.c 


I  capabilities  wlilch  it  possesses,  no  matter  .how  exact 
I  the  technique  employed,  'Hiese  effects  and  capabillcleB 


I  arise  only  in  complex  system.^  of  Interrelated  elements, 

V 

! 

!  The  study  of  the  principles  on  which  oom:plex  .sys- 

i  ' 

j  terns  work,  and  the  study  of  thf^  new  prooecses  and  phe~ 

! 

I  nomena  that  arise  in  these  systems  there fo.re  constl- 

I 

.  „ . _ _ _ ,,  y  ,  _ _ _ _ _ 
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i  t‘!ite  ona  of  the  most  laipoFtant  problems  which  ph3i's5,oI.ogy 
facep  in  oiir 

I  Cybernetics  ■  alaJJ^  in  the  opinion  of  Ashby jt  be  of  out- 
* 

1  standing  Blgnlficance  in  the  solution  of  this  problem., 

I  Yjhich  is  not,  of  ooiirse,  InEoluble  and  in  the  solution 
I  of  which  the  developtient  of  new  teol'inidUBS  of  investi- 
!  g-jatlon  Slay  acquire  decisive  significance* 

\  Ashby  wnr^ltes:  ’^Cybernetlos  rejects  vaguely  intul- 

I  " 

tlve  ideas  and  proceeds  to  the  creation  of  a  rigorous 
science  of  the  prooesses  and  phenomena  which  arise  In 
tirie  Elsewhere  he  vncites, ' ‘’Cy'bernetics  gives 

us  the  hope  of  creating  effective  mthoda  for  the  study 
of  systems  of  extreme  internal  complexity  and.  for  thiel.r 
control » ’* 

The  mofit  important  property  of  cybernetic S“-'thc-5  one 
that  enables  it  to  approach  the  study  of  this  problem*— 
Is  the  fact  that  it  gives  a  unified  complex  of  concepts 
and  a  unified  system  of  Ideas  for  study  of  the  systems 
which  fuiiotion  in  cjr'bernetlc  rniiohi-neB  and  ll.ving  organ*-- 

I  leas* 

1  -Itie  approach  adopted  by  Ashby  /59/  iu  w’hloh  he  coni.- 
paras  cybernstleB  with  the  other  Bciences  and  gciiometry 
3:.n  particular.,  may  be  employed  to  account  for  this  im.- 
port  ant  property  of  cybernetic 
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s 


j  We  know  that  geoniatry  1b  a  science  which  t.t»entB  o.f  ^ 

t  ■'* 

I  the  laws  inljterent  to  highly  diverse  phenoiaena  and  ob-‘  [ 


I  jects  In  space.  Here  It  is  important  to  streES  that 


\  the  laws  of  geoine'try,  which  were  discovered  with  the 
I  ’  ! 

^ aid  of  abstract  thought,  may  be  applied  successfully  j 

I  to  brldge-buildlngi  to  the  construction  of  new  build-  i 

f  ■  i 

i  ingg,  to  SUIT/ eying,  and  even  to  the  ar;.alysls  of  certain  f 

i  '  \ 

physiological  problems.  At  the  basis  of  this  phenomenon,  i 

'  •  I 

.as  pointed  oi^.t  by  E,  iCol*man  /3^/#  we  find  the  imity  of  | 

j  i 

f  the  lav?B  of  nat'ure — the  pree^nce  in  nature  of  laws  cok-  i 

j 

I  mon  to  different  phenomena.  It  is  of  no  Import.ance  for  j 

*  ij 

I  the  soitition  of  a  certain  system  of  problems  whether  | 

[  given  object  constats  of  paper,  concrete,  earth,  iror*,  I 

!  '  j 

I  <j?\Bome  otho-r  subBtaiice,  What  la  important  Is  that  the  | 

i  j 

I  object  has  some  definite  slia.pa  (square,  rectangle,  etc„)<,  | 

1  ,  .  i 

I  '  Time  wo  find  it  possible  to  compare  different  objects  | 


I  i 

S  ih  02"e  another  ero  oranafer  the  laws  dlBccvered,  in  the  i 

f  1 

I  study  of  one  object  to  another  object,  j 

I  Study  of  the  basic  laws  of  geometry  would,  bo  ex-  I 

I  tremely  difficult  if  these  laws  were  studied  directly  j 


through  bridge  construction  or  sxipveying,  'Bie  fact  t,hat. 

J 

\ 

tl-ie  laws  of  gaorrietry  may  be  studied,  independently  of  \ 

5 

the' objects  in.  which  they  find  direct  practical  applies-  | 
tio.n  is  of  decisive  significance,  A  certain  system  of  | 


II 


;  nener'al  problems  and  general  reiationEhlps  appears  in  ,  J 

i  '  ^  '  ...  ,  f 

f  fitudy  of  the  coKiplex  systams  Khich  operate  In  objeota  I 

j  ■■  '  .  : 

I  v?lth  different  physical  natnres^  e.g.j,  In  electronic 
I  computers  arid  in  ttia  variouB  ph/Hiological  sysbemfu  .  { 

f  In  studies  of  the  functioning  of  eoKplex  BjBtemB  ‘ 

I  consisting  of  large  numbers  of  singularly  related  and 
f  interacting  siasple  elements,  we  find  a  specific  group 
j  of  such  relationships.  The  physical  material  of  which  ■  | 

i  o}’B  elements  which  compose  the  system  in  question  are  | 

?  ,  ■  'r 

I  in  turn  cojripoBed  (proteins^  BetaXBjs  eto»)  iB  unlttjpor™  j 

I  tant  for  study  of  these  relatlonsbps.  'What  is  impor-  j 

f  I 

i  tant  ic  the  kind  of  influence  exerted  by  certain  ele«  | 

f  ■  '  K 

I  Trents  on.  others;^  how  they  inier'act,  and  the  .etinictural  j 

■ 

1  arrangemerit  into  which  these  elements  are  ooTshined.  | 

1  ■  f. 

j  The  presence  of  Just  s-joh  a  corrtraon  group  of  rela-»  f 

i  tlonships  Is  what  Biakes  it  possible  to  transfer  the  j 

I  principles  and  phenomena  discerned  in  the  study  of  one  [, 

I 

I  system^  e.g.,  in  the  study  of  electronic  computers^  to  | 

I  i 

*  another  .Bysterq  e,g.,,  to  investigation  of  the  laws  which  | 

t  '  ■  /  '■  ,  :l 

j  govern  the  activity  of  tha  brain„  Many  important  ques-  'i 

i.  tlone  ca,n  be  answered  by  study  of  radio-electronic  sys-  ' 

I  terns  during  study  of  the  processes  unfolding  in  tte  I 

I  various  cybernetic  systeEm^  These  (radio -electronic)  | 

I  systeaiB  are  highly  convenient  for  study  of  a  whsl.e  series  I 


•RUMHaTA; 
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-■-.-u,  - rwinr'  i^Miiiir  ■niir~""-*TTr***1*‘"“^  - 

;  of  phonom^na.  Owing  to  tfca  poeslblllt;/  of  - using  this  I 

f  ,  ■  .  '  .  I 

i  yitetho-d,,  we  have  great  new  prospects  for  study  of  a  .  i 

I  miR;bex»  of  theoretical  problems  related  to  ttie  operation 

;  of  complex ,  systeEis  of  procesEes—a  circumstance  which  1 

.  ■  1 

.  m.y  be  of  decisive  signiflcanca  for  analysis  of  the  op-'  j 
tn’s.tlon  _of  ttie  brai 

'  ■  ’  ■  '  ■  i 

1  The  above  princioles  determine .the  boundaries  within  f 

f  wliloh  it  is  possible  to  compaxa  the  operation  of  the  | 

^  .  ■  J 

r various  systems  mxd,  in  particular,  to  compare  the  op-  j 

I  oration  of  cyberjcetlc  sjachines  with  that  of  the  bx^aln.  ] 

I  J\  group  of  i^lationshlps  related  to  the  functioning  of  ! 

"  ■  'I 

?  tyc terns  of  interrelated  elements  in  which  cosplex  in--  | 

i  ■  -  '  I 

^  tor-mat  ion -processing  and  control  mechanismb  are  in  evl-  ^ 

;  .  .  .  -  ,  ;  I 

;  flcTKi.i!  is  ooj's'ffl^o.n  to  the  operation  of  the  brain  and  that  I 
!  ! 


f  of  cybernetic  machlnea, 

I  At  the  same  time,  when  we  oonrlder  tha  brain  Ifrom 
}  • 

;  h  ctandpolnt '  of  Ehv.y  of  the  complex  biochemical 

i- 

If  •  • 

J  cubs cianoa -exchange  orocesses  which  determine  the  actly- 
)■ 

i  ity  of  the  nervous  system— from  the  standpoint  of  the 
[  laws  governing  the  ti’annfer  of  energy— detect  no  Blm- 

^  -V  ■ 

I  ilar-ity  between  the  br£:ln  and  the  oyte-rnetlc  machint^'i, 

;  It  is  also  necesdar-y  to  stress  that  man  is  a,  prod- 
]  ■ 

jiict  of  Eociol  activity,  and  thb.t  the  o.onsoicat.sne£;s  of 
I 

itl-ie  human  being  is  In  large  part  determined  by  edaca--» 

I  ■  '  '  I 
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■  tlon^  tfe  oonditionES  of  Ms  .social  aM  i 

his  life  experience,.  Ph:y'.slolagic'al  ppooeasee  determine  ! 

I  only  the  mterlal  basis  on  which' the.  personality  of 


I  tlKj  htsaah  develops^ 

!lMis  a  geiienal  ccjnpanlson  of  man  with  a  raachine 
is  possible  only  within  the,  narrow  fremwork  of  study 

i  •  '  8 

of  the  rel-ations-hipe  mnifested  in .  cois^lex  systemg^j 


j  BTid  with  the  .Ea^e  degr^eo  of  certainty  ^iirith  wMoh  we 

. 

,  Epe.ak  of  the  possibility  of  applying  the  general  prin- 
oiples  of  mathemtioal  analysis  to  the  study  of  tte 
brain *s  operation^ 

In  sp-eal'Clrig  of  a  narrow  comeoh  group  of  relatiori- 
ships^  'however j,  we  do  not  isean  to  deprecate  the  poten¬ 
tial  of  the  ntaohinc?*  l?hus,  for  example  >  we  frequently 
encounter  the  proposition  that  the  prograjE  of  opera- 
i  tic-n  of  machire  is  fully  determined  by  i.ts  designar 
and  cannot  be  modified  in  the  process  of  oporat.lona-  It 
shoiild  be  noted  that  th.ls  la  not  altogether  true.:. 

Even  the  automatlo  device  descri'bed  at  the  end  of 
the  present  volume  generates  its  program,  precisely  as 
a  result  of  ** study”  of  the  oo.nditions  surrounding  itj» 


restricted  as  they  may  be*  But 'this  device  1b  very 
Eimple  indeed,  and  It  was  constructed  with  the  rather 
modest  BurDoae  of  'SiiHulatlns;  certain  of  the  learning 


14 


;  procaBsee  of  snlmlSo* 

I  Mari*e  •uiidepgtaridtns  of  na,tui^>  Innluding  hlraBelf,?, 

^  inoreaBOs  in  profundity,  and  there  is  no  doubt  that  l¥; 

[  Viiill  create  automtlo  iBaohines  tlxat  simulate  many  of 

5 

'  tbe  functl^viiB  of  the  brain*' 

I  . 

It  Is  frequently  stressed  in  sps,al':lng  ot  oyl'^ernetlcs 

K 

t  that  reeogn^.tion  of  analogies  in  the  opejratlon  of  the 

f 

'  c^’bernetlc  mchlnes  ii.d  the  brain  is  Inportsint*  This 


tendency  seems  unjustified  to  tlio 


authors, 


le  wora 


j 

i 

} 

i 


:  Vnalogy”,  It  seeiiis  to  ue,  does  not  ■oreelsely  define  I 

j 

I  tie  system  of  inter.relatlonship3  which  preyalls  In  study  | 

»  '  '  ■  I 

,  m  tncse  two  higlily  different  objects,,  The  qiBStlon  of  1 

■  •  '  I 

•  the  justification  for  comp.aidng  the  brain  and  the  i 

■'  .  > 

!  ^ri,f;,.'jrjlne  vnlll  inevitably  arise  if  the  problem  ’is  thus  ,  | 

i  ,  ,  .  i 

^  stated o.  i 

i  '  t 

j  4  whole  series  ot  special  investigations  has  been 
I  ! 

'  a.:' ved  cn  this  prcDj..-  A‘  /35j>25r^<-/*  We  consider  It  much  ? 

<  more  correct  fx'oia  tne  methodological  viewpoint  to  speak"  :  1 

I  ■  I 

f  ol‘  the.  existence  of  a  certain  narrow  circle  of  relation-  I 

i .  .  I 

f  ships  common  to  the  oper.ation  of  the  brain  and  the  ma--  r 

i  ■  ■  i 

t  chine?  those  relationahips  which  are  connected  to  the  I 

I  j 

I  functioning  cf  complex  systems *  | 

I  '^See  pages  56-58.  | 
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I  . . .  -< 

i  It  ia  a  fa.rslllat'  fadt  tliat  th^  basic  laws  of  re*- 

f 

j  fraction  of  light  ai»b  .eq.nall3?  •usefal  in  sttidy  of  the 

jfiyci  and  in  tha  study  and  design- of  Yarlous  optical  in- 
I 

i  BtrtimantSa 

I 

I  niiehe  3.a¥S  common  to  these  two  highly  di.SBlsillar 
{ 

j  p]rienaiaena.„  Goimarlaon  of  tiie  eye  and  -an  optical  sys-tea 

i  • 

I  &B  regards  tlTeir  other  properties  and  ttieir  opens:, 

I  princ5.,ple0  would  oleaidy  be  an.  error>  The  Bfme  nalation-- 
I 

I  ship  exists  in  etjudy  of  tlie  brain  and  the  cybernfi'tic 
mchlne*  - 

b)  ffethods  of  Inrestlgation 
The  objects  which  cybernetics  studies  are  highly 
diversified-^  The  proMem.s  of  Isiforffiation  procesalRg,;, 
control,  and  comtiiunioatlon are  common  tc^  mai’y  sy-steasj, 

» 

living  and  nonliving,  and  this  naturally  nuikrs  cyber-  J 
netlCB  a  science  closely  related  to  a  mm'ber  of, other  .  j 

7 

sciences,  such  as  Hiathematlcs,  physiology,  neurophysi-  j 

j 

ology,  and  radio  electronics®  | 

W'3  are  cciicerned  here  with  one  of  the  divisions  oi  j 

cybernetics-“neiiroaybernetiaE®  This  tern  denotes  the  I 

study  of  control,  comunicatlon,  E,nd  Informtlon-pro-  | 

ceasing  raeohaJiisms  l;n  living  organissas  and  In  -autcffiatlc  .  i 
I  ■  1 

j  devices  created  by  Juan  for  simulation  purpose Sa  j 

i  It  is  clear  from  the  above  that  gr-'Cat  slgnifio-ance  | 
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-is  attaobed  to  stintilatlon  cf  the  proceases  that 
place  in  physiological  syeteBis, 

¥e  .know  little  about  the  operation  of  the  brain  or 
about  the  neurophystological  structure  of  its  oorteXt 
br3,in  may  be  represented  as  a  co3ij.plote'  cyhemefcj...c 
syatemy  but  without  appreciation  of  how  it  is  organised 
I'Jc  may  form  varicus  typotiieses  conofcrnlng  its  structure 
siimlatlng  isolated  funct5-ons  of  the  brain  v!ith  the 
a:i.d  of  ooirgi-utorE* 

Hie  study  of  cybernetic  radJ.o-elect’Ponio  systeas 
and  iticdelB  opens  before  the  investigator  wide  prospects 
I'cr  .scientific  analysis  of  the  phenomena  which  unfold 
f;r.  complex?:  .systems,  ard  particularly  for  study  cl.  ,con-' 
r;rol-^  inform,ation~proce3Sing».«  and  Inforration-codine 
activities  and.  the  l^Jcc-*  Hiese  prospects  are  due  to 
uhe  fact  tliFit  the  •e-ci)eriir.anter  can  asEemble  varlolia 
and  dis?!!r.'50-3)vle  them  into  their  parts  as  he 
'i&'S'B  fit.  It  Is  possible  to  study  the  operatiOi*  d  d.!..f*” 
ferent  sections  of  trie  Bjachd..nes.^  design  dixierent  model s^. 
etc,  ’Jliese  liiethods  of  investigation  also  enable  us  to; 
.study  the  interplay  of  various  complex  radlo*«electroiilc 
systems  with,  ono  another.  The  result  is  tnat  this  Ksetliod 
:nas  been  related  to  the  sig^iiflcant  progre.BS  ma:3.e  in  tl'ie 
recent  clevelopinent  of  this  s-clenoe » 
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-fi'n.'"**'’** 


i 


■atBMKMOHaati^/^ma 


On.  eXCTl.natien.  of  attemptE  to '  .simulate  the  fuiictlorss 


s  of  tl'je  brain,  we  dlEcern  two .  fimdainontal  d5-neotioria  in 


i  which  tbs  Ec-isnce  is  lacYlng,  The  first  path  l.'S  from  the 

i 

1  Kiashine  to  tbs  brain*  Attempts  are  being  made  to  create 


I  an  arttfloial^  synthetic  brain  by  way  o.f  speculative  con- 


f  eit-aiicttoriB  without  consideration  of  the  actual  .s  true  Imre 


of  ths  brain—t^eo-^^  by  ahBtraotiUK  it*  It  would 


I  isesM  that  even  iichby  follo^jed  this  roi'te  In  deBignlng 


I  his  homeostafe  and  deoerlblng  a  ^'thought-capacity  arapl.i~ 
fier’*  By-iStem,;,  Thl.s  course  requires  a  large  outlay  of 
ti'S;!  and  resources,,  since  it  is  Btlll  based  on  thiS-  trial” 
a.nd“i*ifrror  method,  bo  Bplenrlldly  embodied  by  fy.'S'®  Anhby 
in.  hie  hoiseostatw  But  this  approach  furnishes  very  lit¬ 
tle  InforHatlon  on  the  organisation  of  the  bxmin,. 

The  otlier  course  of  investigation,  is  based  on  stT?.dy 
of  thB  brain  by  physiological  laeihodE  with  the  irarpooe 
of  i»eyeal:.lng  the  general  laws  governln.£  its  a,cti.'vlty 
and  using  the  simu.lation  r^sthod  from  that  point  on.* 

ifere  cyberrE&tic0  is  concerned  with  oora.plex,  syEtsme 
Dibich  fuiiotl.on  in  nature  and.  x^iich  a.rose  mid  took  .shape 
I  as.  a  of  the  long  of  evolution  of  the 

I -organic  universe*  The.B.e  sqmteius  (the  braine  -of  Fis.n  and 
i  the  anteals),  wliose  ope-ration  we  o-an  study  and  describe 


j. 

I  j..n.  general,  terais,  xxossess  a  nmfllier  of  properties  lacking 
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in  coriteiijpopaiy  cybernetic  sjachine*?.,,  Principles  and 
phenomena  which  ares  as  yet  unknown  to  eclenoe  ere  rea;l« 
Ised  in  tijeJJi.  The  study  of  these  systems  Is  of  yerjr 
gresl;  interest  for  this  reasons  But  in  tliis  case  trie  in*-' 
ye:,tlgator-  also  comes  up  against  great  difficulty  in 
I;::’-' o securing  h.ts  experlffiental  x^esam'ch^, 

Is  a  rules  tho^^  methods  which  prove  applleahle  to 
trM>  study  of  radio-electronic  systems  cannot  be  applied 
to  study  of  blologloal  systems,^  and.  to  study  of  the 
train  In  particraar>  The  problem  which  the  foDceign  lit¬ 
erature  refers  to  an  the  ’'black  boSc"  tas  arisfe^n.  Its  es- 
so, :\,c€  '  consists  In  the  fact  that  In  the  course  cf  an  iU'- 
v.r'.tigatlonj  man  may  apply  a  certain  disturbance  to  the 
that  he  Is  studying  ajid  take  Into  account  tiie 
reiponsoQ  with  whicli  the  systeia  re.acts  to  theses  d.lBtu.r- 
banoeih-  In  the  courh-  of  the  eneperimcrnt  be  cannot -di- 
t  .'en37y  the  pro. os  occurring  in  the  train  and  ca.n'' 
;-'o;-  cfltablleh  1;ok  'f-e  nerve  colls  that  parti.3ipat3  In/ 
this  v:ox';:  cf  tliC'  bra.5,n  corjnected  to  one  another „ 
Physiological  Investigation  may  lead  to  the  recog¬ 
nition  of  a,,  mxribcr  of  important  properties  of  the  phe« 

,  nomona  under  study  and  to  the  formation  of  hypotheses 
I  concerning  the  nature  of  the  jxtjysiologioal  pissjchanlsme 
imder-l.ying  theme  This.  hypotbes5.E  may  be  oreatx^cl  on  tte 


-r-rfrtvrfM' '  •  w 
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Msls  of  all  InfcrKation.  at  ©t^  dispasal  In  tM 
fields  of  oyljenietlois  and  the'opetloal.  xm^ixpolog^ ^ 

'Sbe  noxt  stage  in  the  investigation  .sliould  lae  tbe 


oraatioB  'of  the  oorrcsponding  radlo-eleo^^"  I 

trojii.o  sodel  „  r^allsration  and  study  of  this  modfsl  [ 

can  OTOTlde  veid-floation  of.  the  hypothe-Bls  acivsnced  | 

I  '  '  ■  . 

I  and  dftsotlon  of  Its  lnade«pBole.e  and  'Than  a  i 

I  nlSii  oan  be  outlined  foi*  a  nen  series  of  pliysiologioal  ’ 

I  e:HpetdJs,ent»,.  which  may  lead  to  fete  creEtlon  of  a  naw  hy-*  j 

oT  roflnaaant  of  the  old  0103 »  ) 

'  ■  I 

Ihus  tMa  Method  should  Incorporate  a  serieii  cf  m.o-  |. 

i 

o€ssiY«  pMaas,  Bom  of  which  related  to  e^sparliients  | 

.1 

vdth  £miJsai.B  and  otmvn  to  the  creation  of  cy?3ernetlc  j 

id.?s£ula,tor»«.  ■  =  I 

■llie  creation  of  e:Ki>erisental  models  may  he  of  great 

value  for  the  recognition  an.d  pSL'eelste'  definition  of  ( 

i 

the  profcleKB  astride  the  2?o^  to  tho  investigation  of  ;  I 
physiological  procesaoB*  i 

¥e  have  teen  oonstantly  impressed  In  ottc  worh  with 
the  fact  that  in  creating  a  cybernetic  i'^adlo-oleotrenic 
K’^tdal  of  oti©  or  another  plsyslologlcal  pJ^enomenon  w©  in- 

} 

-  _  ii 

variably  encounter  a  large  maa^r  of  new  problems  that  j 
I  necessitate  conducting  whole  series  of  mw  phystologioEl  | 

1  experiments ».  .'  I 


;  Trw.B  the  second  route — ths,t  from  "drain  to  machine" 

f' 

I  --eYldently  offers  gi^eater  poBSldlllties  for  0tu%^  of 
I 

;  tlie  Toraine 

1  c)  The  Rc-le  and  Position  of  Cybernetics 

‘  Ir.  a  System  of  Physiol cglcal  Iiwesti*- 

'  p:atloris 

i  ' 

:  Tho  difficulty  of  studying  physiological  processes 

^  is  often  due  to  the'  irnreEtigator^s  en count sring  coBiplex 
:  j.‘Tt6^r actions  aiaong  a  t,itr-ge  ntinibei’  of  physiological  jiro^ 

I  o-:'SS3S  whioli  unfold,  simiatane-ou-sly  and  Infl-aence  e.acli 
-'oner  i-^clpi’ocall;/*  As  an-,  e.-icample,  vie  might  note  the 

i 

^  syste-rn  o.f  physiological  processos  that  unfolds 

1 

ivicien  oondltj-cns  of  intensive-  muscul.ar  activity  of  an 

'f  .  •  , 

,  v,-<gan.ism  in  the  alisTentary  canal  afte.r  ingestion  of  fooci^ 

'  -.■-•■  ■  w..  The  basic  m.ethod  of  in':/estigation  in  this  ca.se  co.n.“- 
I  slsts  in  attempts  cm  the  p-art  of  the  inve  stlgntor  r.om.e*-' 

'  -■.-.-■r,’'  to  i&ol-ate  sovjc  c.ingle  ppoee.s-a  from  the  coropleov  syrr- 
f  ■ji.i.rl:.  a  vieu  tu  or;u^Iylng  this  phenomenon  under  preciBe 


e:p£rl?vit.r:,tal  conditions,,  Metliods  of  InveEtigaf-ing  IsO" 


j  lated  organs  or  pax-ts  of  organs  (e„g^j>  r3eu:rom'usc-itlar' 

! 

i  preparations)  gre  widely  usedc 

i  .  .  .  ' 

I  The  isolated  ohemleal  reactions  are  studied  in  tc^sl; 
(  tu>>e.s,  Tten  a  second  stage  of  the  inveotigatlon.^  'In 

I  which  the  investigator  atteiipta  to  unify  all  of  the  in  " 

i 

I  dep-endently-studied  proeesssB  into  an  iiitegrated.  Bjrstem 


jawar.-.t, 
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i 


land  ri.w<ml±m  the  entix^  iKte|p?ated  coiaplex  pictaire  which  j 

I  I 

I  SFiF4iS  on  Intoractton  of  these  processes^  heooises  necejS-  i 
I  sa:v?^%.  'H-ils  stage  of  the  investigation  is  highly  exacting  ; 

1  and  d.ifficn3,ti  since  entirely  r^w  piienoaena  Bxid.  r-alation-"  | 

I  ships  which  it  is  dlfficnlt' to  pnediet  on  the  basis  of  j 
I  study  of  the  isolated  os^gans  and  reactions  usually  md,S3'  ] 

{  in  the  course  of  the  interaction  of  the  various  physic-  | 

I  logical  procesBes  (as  stiidied  In  isolation),  I 

ah®  different  processes  Influence  one  another.^  Ihe 
esaerge-nco  of  one  procoES  smy  liitemapt  the  course  of 
a:nothei^  or^  conversely intensify  It |  here  the  .Influence 
of  oi]0  proce',ss'  on  the  other  may  b®'  deteralned,  by  the 
pbate  In  wh5,ch  the  Inl'luence  la  e'xes^ted,  and,,  consa'*  • 
quently,  depend  on  cbr,ngos  ocoicrrtng  in  short  intervals 
of  tis5is>  '  '  , 

Finally,  the  e-ssergence  of  a  new  ipt’ocess  may  direct 
tne  coarse  of  another  in  an  entirely  different  direction 
Bbr  thl.0  i^-ason,^  .special  techniques  of  investigation  | 
involving  the  cs^estlon  of  certain  BohemBitlQ  constructions 
on  pai>er,  using  certain  symbols  to  r'epresent  tlie  over-'all 

I 

picture  of  the  physloloitcal  processss,  acquire  decisive  | 
signiflcarice  in  the  process  of  the  sctent.i.fic  inve  s.tiga-»  | 
tioiu  It  beeo:me&  possible  by  this  method  to  fora  a  clear  | 

I 

concept  of  the  flow  of'  the  processes  in  tl»  orgimism.,  to  | 


.  di‘t»'»{  a  jssr-ies  of  5.mpartant  conoluslons  regardio-g  the 
i  ■ 

I  of  their  interact ioiv  and  to  map  out  a  plan  for 

;  new  experlmantB* 

i  Howe'ver,-  this  pnobler  cannot  be  f'o.lly  solved  by  tl'ie? 


:  inethods  ot  analytlosJ  investigation, 


'  The  :,ir*thO(S  of  etudytng  .the  ^^whole  organlfjm**  acquinoB  I 
I  ?p.'eat  significance  In  this  connections^  As  we  know^  the  I 

'  '  .V 

f  ■  /  1  ^ 

?  researches  of  I,  F„  Pavlov  and  his  students  I 

''2':)/  were  of  decisive  Sj-gnifloance  in  the  developnieint  of  1 
'  th?s  mithodo  i 

i  The  basic  prinoiplcB  of  this  jrethod  involve  the  in~  j 

!  : .  'e 

‘  ■.■T'f.tlgatcr ®3  application  of  varlon©  sets  of  cllEtTirbanceB  | 

the  org.anisffi  of  the  healthy  animal  in  the  coupse  of  | 

,  tiiC-  e^cpenlrfient  (he  IntroduceB  new  aubstanaoB^  applies  | 

i  '  '  -  I 

!  signal  coTiicleXeSj^.  etc,,)^  The  complex  responBes  of  the  f 

‘  ‘  ■  .  '  '  ■  ,1 

I  organism  to  tite  disttn’bancos  produced  are  obaerved  dun™  | 

!  f ■  ■”  the.  experlffcnt  (r,.^^cB3-prcit?Bu^e  levels  are  HeaBurad.^  | 

i  ! 

if  pvi.;.se  mctoi-reflex  reactlone  recorded^  galivax*y  \ 

^  ■  ! 

I  secretion  noted^  etCo)„  In  this.,-  as  a  rule,,  the  irrve-stl-  j 

I  'I 

j  gator  oBimot  conduct  direct  observatiori  of  the  phys-ln-  | 

'  i 

I  logical  procesBPs  under  way  Inside  the  organism^  In  Ms  :  f 

i  '  if 

!  detailed  disci' sslon  of  thiese  r«ethode;»  ¥«  Roris  A-shby  /6o/  | 

I  I 

I  uses -the  tem  ’’black  box”  with  the  intent  to  strcBs  that  | 
I  I 

I  during  the  investigation  the  invoBtlgator  knew©  orxly  the  | 


■  g^n33?al  «hs53?act€5t*  of  tb®  eriiaable  of  dlstiirl^aBO®®  b®iiig  | 
applied  to  tbe  organism^  tmd  cannot  follow  ths.mifold*-  j 
ing  of  thB  pfc/^ilological  pi'»ocas3aB  directly «.  It  is  iat-"*  ■  j 
'  possible  'to  draw  -dii'act  conclasions  as  to  the  eharacter  j 
of  the  physlologioal  st^s^chanlsms.  on  the  basis,  of  tliese  .  j 
experlmnts*,  In  this  connection;,'  tmqmnt  recoiirse  la  ■  ; 

tah:an  to  the  eonstruotlon  of  worl-ring  hype  theses.,  .ITtia'- in-*  ^ 
%'©Etlsator  lisnally  tak©.0  up  pencil  and  p-apea’  to  create  a  .  j 
dafinlte  hypothetical  flow  ischeae  of  the  nerveus  proces-  ! 
EfeE»  In  drawing  -up  this  iiypoti^sis  he  Miates  v.Me  of  the  j 
sim  total  of  information  gained  prevlonely  on  basis  ■  | 

of  study  of  the  physiol-ogy  of  the  Isoiiated  org^iSj  as  f 
well  as  all  of  tlie  aoMeveaents  of  physics^,-  cteadstrj,  i 
bS-ologyjn  and  other  dlEOlplin®®  with  which  I'je  is  iEalllar<.  | 
It-  .shovld  be  st'j«?sse.d  that  th-e  hypothesis  aele-cted  does  | 
not  always  prccee-d  directly  from  the  results  'of  experi-  ■  j 
raent^  It  is  the’ result  of  creative  general tssat ion  of  ! 

all  available  scientific  knowled,^’  at  tlse  dlspoaai  of 
tlm  scientist*  the  result  of  a  certain  ' creative  process 

? 

. 

wMoh  the  use  of  various  analogies  and  parallels  soBe-  f 

,  I 

tlsiss  plays  a  isajor  role^  l^ottieses  frequently  appear 
as  a  result  of  oMnoe  ’*‘brainstdjraBs’*  of  the  investigator, 

I  '  i 

I  In  analysing  tbs  »thods  of  irivestigatlon  described  I 
I  above#  we  should  devote  special  attention  to  the  stage  .  | 
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i  Oi.  t>i£:;  lnve,Btiga,tion  in  whloh  the  hypo  the  3ie  is  created, 
I  Ihis  phase  1b  extre^ly  iJiiportant,  since  the  direction 
I  of  tlie  entii‘e  subsequent  expenirf^ntal  prooeclure  depenclE 
I  orx  it.  Major  difficulties  ar-e  frequently  encountered  in 
:  the  real i?;atlon  cf  this  and  It  is  tore  that  the 


{  relationship  of  physiology  .to  the  at.tairraents  of  other 

I  .  .  • 

I  rexenees  heoomeB  most  clearly  evident, .  This  probleia  le 
j  c.?  ij^iportance  for  us  beeauEa  it  is  preclBcly  in  this 

I  '  ■  , 

j  p'V-ise  t!iat  the  role  of  cybernetics  in  tiie  over-all  oojh- 

I  of  pliysioicglcai.  investisations  may  show  iiB  value, 

I  It  must  be  stressed  that  the  forenilatlon  of  a  cor- 

<  hypotherils  in  physiology,  which  opens  broad  are- 

,  I o  wO  further  exj.)erl,iii!3(:M'xtal  research,  1b  Ixw&riabiy 

(  t;  0..  on  attainments  in  the  correspjondijig  branches  cf 
f  ,,  .  ■  ,  '  / 

I  o.fier  sciences,  The  developi5»=?nt  of  physiology  has  al- 

I  ways  been  Inti.mately  dependent  upon  the  attaiiments  of 

j  :lc3,  chemiBtxpi",  the  progress  of  teolmical 

j  vu,,-.,x.ght,  Scientists  to  thla^i^y  be  arg'.iing  over 


I  chc  .significsance  of  e.xpanslori  and  contraction  of  the 

f  ' 

I  pirpll,  aha^igOE  In  the  crystalline  lens,  aiid  other 
I  dxaraoterl  sties  of  the  operation  of  •  the  eye  tad  Hie  laws 

i  ' 

I  of  refraction  of  light  in  lenses  not  been  known.  The 
f  work  of  the  heart  became  under stoed  as  a  result  of  the 
fact  tlm.t  apparatus  working  on  the-  sai-,ie  principle  as 
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jifcs  heart  already  e:d.Bted  in  technoloiSf»  Tli®  discovery 
I  of  the  p'lienofflena  of  radiii*  ift-ade  it  pos^sibl*:?  to  wndei*"-* 

I  stand  the  ffiechsrisMs  which  pePBit  bats  to  fly  in,  total 

i 

j  darkness  without  colliding  vrith.  obstacle s,> 

\  Apart  froB),  these  difficulties >  the  study  of  ce-rtaln 
i  iihy Biological  laeolmnlsias  i.B'  considerably  ii^aded  by  the 
i  fact  that  the  physical  phenomena  at  their  roots  have 
I  not  yet  been  studied^  It  Is  such  a  Eltoation  ■whxch  we 
eiicounter  In  the  case  of  study  of  the  b.eB,.t.n* 

iiie  lack  of  the  corresponding  Inforsis/cion  in  the 
:  fields  of  physics,  chemistry and  technology''  liiEdces  It 
Impossible  to  construct  a  hypothesis  that  will  gu-gccam- 
tae  the  corr-ect  direction  of  the  e.^?:perli»ntal  physio¬ 
logical  im/e,EtigatloriS» 

11:10  analyBlE  furnished  above  defines  tte  place  of 
i  cybernetics  in  the  system  of  phyBlologtcal  Im^eiStliga.-' 

!  tions.  It  creates  the  tlieoreticsl  pivcmlses  on  which  we 


I  ffiiay  formud^ate  valid  hypxjtheses  and  concepts  of  tbs  na- 
j  tup*»  of  the  ph^’-Biological  mech5tnlsms|  as  we  have  noted, 

1  it  thereby  determines^  the  direction  of  fiJirtlier  physio¬ 
logical  exp&Tlmint&tAon  to  a  conside;rable  degree,  pro’Vld- 
:  3r.g  for  s^alc^ction  of  the  most  valid  aiid  promiBlng  paths 
j  of  investigation »  Ife  must  concur  with  Afi-hby  /59/  that 
I  the  lack  of  profsress  In  tte  study  of  a  whole  .siaries  of 

it 


I  physiological  pi^obloms  has  been  cine  to  lack  of  knowledge 

I  of  thie  general  prlnoa.pl.es  an.d  relationships  governing 

f  tte  flmctianing  of  complex  systems^  Cyberne-tics  fomri-^ 

I 

I  lates  such  a.  tteory  and  tliereby  creates  new  preriilses 

i  for  tJ-iP  succassfrl  development  c-f  maty  departmenta  of 
}• 

I  plAysirilogy* 

I  We  must  point  out  the  erronecus  natiti’e  of  the  idea. 

j  tba‘c  cyberrietics  may  replace  or  ’-rerider  Tjoinecessary’’ 

! 

I  the  physlologtoal  methods,  of  inve stlgpHon.!s  and  also 

'i 

I  of  tl-ie  a3Eertio.ri.  that  eybe'rneti.5s  alone without  bane- 
I  fit  of  physiological  experimentation^  cmi  solve  bio- 
logics!  probleriiE  (and  the  pro.bl.em  of  the  brain  In  par- 
^  tiouiar)^  It  does  not  eliminate  the  necessity  of  using 
]  cj-.'lstlng  itiethods  of  eyperiB^nta.1  physiological  investl« 


gation^  but  can  only  Kia-tee.  .these  methods  more  effective »  i 
In  concluding  this  sectlonji  attentlo,n  should  be 
devoted  to  certain  problems  related  to  ttm  use  of  almtv- 
I  lation*  It  l3  still  necessary.  a.t  the  present  time  to 
1  listen  to  cbleotlons  to  the  use  cf  thi,.s  approach  in  j 


physiology*  Tl'ie-  simTilatlon  metiiod  has  nevertheless  been 
used,  in  various  fields  of  science  and  technology  for  a 
long  time  *  Prior  to  building  a  new  machine  or  l'nst3rament 
or  designing  a'  new  tC'Chiiologleal  installationji,  engineers 
very  frequently  construct  model  B  of  thteir  fut'ure  orea- 
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tlona* .  TiMi  Kodol  is  uEually  not  an  ereot  copy  of  tte 
ijistiillation  being  designed.  It  my  be  .  built  with  other 
ma"cspi.ala.^  or  have  totally  different  dimensions,.  In  epite 


tMs.,  certain  important  relationships  .wblohuitre- of 
preat  tiiiporianoe  tO'  the  work  on  the  project  my  l>e  diS‘ 


or 


eovered  in  study  of  sueh  aatodei^  .  •  .  J 

Simulation  Is  also  et^loyed  In  cheiriistry  aii:!  pl)yulos:.,  f 

I 

Indeoci^  even  the  straotural^  formla  of.  a  chemlcai  odmpoun,d| 
Is  already  a  kind  of  model  in-  certain  sense  ©le  in-”  ^ 
dividual  atOMB  «ir:;d  thcdr  :bonds  are  denoted,  in  tbi.s  model  | 


Kith  the  a5.d  of  defined  aymbolSv  ^ 

Mc-dels  Eiay  be  used  to  form  a  conception  of  '&m  course  | 

,  „  .  f 

of  oorapleT-  chemical  s’eactions*-  W.»  Rosb  Ashlay  /60/,  .presents': 

I 

an  interei^tiJig  e2:a®|}le  J.llustrattng  the  advantages  of  | 
this  methods  He  reefers  to  the  fact  that  using  the  pencil-  ( 
and -paper  Bimulatlon  laethod^  Leverr  ier  and  Adams  dis-  | 
ccvereci  the  new  planet  Neptune  in  a  few  months  I 

wM.le  the  solution  of  this  problem  by  direct  telescopic  ? 

I 

searches  for  thcj  planet'  would  have  required  the  solan-  | 
entire  lifetimes*  .  [ 

•  V 

But  scientists  also  use  suoh  Biethosds  of  Pimiiiation  | 

i 

in  studies,  of  pliyslologleal.sM  bioohemieal  proeessea^  .  i 
As  we  have  said^  scientists,  freqssently  oome  up  against  a  ,  j 
comple^E  pattern  of  Interaotlons  between  mr«x»ous.  physio-  \ 
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I  Idgl.cal  prodepses  In  the  is?  sti^dy  of  living  oi^gsinijmSa  | 

I  '  '  J 

Tl'ieee  proossses!  unfold  oonoui'rently  and  3?eoiprG'cal  ? 

,.  ■  ■  .  ■  j 

f 

I  inf In once s  on  one  another*  ; 

?  .  s 

I  One  oftlie  nrost  critical  eta^B  of  a  phyBiological  | 

I  investigation  Is  the  oreatlon  ef  definite  soteases  on  | 

1  ' 

s  paper,  Tlxe  forruulation  of  suoh  solie^n'iies  my  be  of  gi^eat  | 

j  ■  •  f 

?  Elgnifioance  In  the  process  of  the  BClentl.fio  in'veBtl-  i 

I  '  i 

*  gat  ion  o  In  th.iB  vfay^  the-  expa-riJRe  liter  can  forai  a  com-"  f 

•  ■  I 

■■  plete  ooiiCeptlon  of  the  complex  phenoiTiena  mider  study^  I 

f  .  • '  ■  ^  .  r 

I  g^jneralizlng  l.t  to  5.ncluci.e  infonnatlon  obtained  at  dlf-  ■> 

1  ■  ■■  .  '1 

I  ferent  tlRiea  and  by  different  methods*  On  the  basis  of  j 

analysis  of  tSie  sol:^Rie^  he  may  create  neif  working  iiy-  '  I 

-  pobheses  and  mark  out  new  series  of  physiological  ex-  ! 

■  J  perinijents,  .  •  ,  I 

I  ! 

I  Tlie  m-ethod,  by  vdiioh  such  schemas  are  formulated  is 

^  I 

esBcnitlally  t)ie  simulation  method*  I 

*  'TeohniQues  have  recently  been  developed  which  per*"  f 

?  ■  I 

i  ‘  ■  ■'  I 

I  mlt  the  creation  of  dynamic  laodelo*.  ModelB  of  various 

I  physiological  processes  and  phenomena  c;m  be  created  | 

in  modem  cybernetic  maohlnas*  Tl'ie  use  of  such  models 

I  ooiild  play  a  ma^or  role  In  study  of  a/ whole  series  of 

I  problems  of  jnedicine  and  .physiologjr*.  Active  Member  of  | 

I  the  Academy  of  Medical'  ScienoeB  of  the  USSR  7*  V*  Parin  | 

I  ^ 

has  noted  the  slgjiiflcance  of  this  direction  for  the  I 

•  ijf*-  Mjniwrn.i  •nntn--r.  ~iri  itT'tiiiiium'J  —■ i - ■  — ■....., 


X 


-•WSR'iVaL 


29 


\  ,  .  ■ ,  IIII^II  iiiimii  Ttimiift  -i 

I  of  sa^dloa.!  » 

I  1311,1®  the  m  to  It  i®,  neo^ss-W  to 

lum  imn  already  teen  answered  in  the  practice 

[of  scientific  .research. 'At  present  tl»^  it  seems  ^ 

I  to  us  tlmt  miothex-  <|usstlon*-tMt  of  whether  we  om  ■. 

I  to  contew^orar^  achie’^^^nts  of  technolosr  to 

I  perfect  to  actual  jretods  used  lii  to  creat^.on  of 

I  i^del0»-has  acquired  more  p2?essing  slg.nlf Ipano®  ^ 

AS  'to  been  noted  hr/  the  erdmnt  Soviet  sclenclst 
A,  I,  Berg  /J.Oill/0  recent  .attainasents  of  radio  eic-o- 
tronlcs  are  opening  toad  posBihilitles  in  this  respect. 

It  mat  he'Stossed  at  to  ©0J«  tllS^  tlmt  the  siisu- 
lattcn  jssthod  cannot  in  itself  solve  physihlogtcal'  prob¬ 
lems.  It  acquires  ma^or  algnificanoe  only  in  cases  where 
It  is  used  in  close  comMmtion  with  tte  ptr/siologleal 

1  metlKjds  of  investigation. 

I  to  creation  of  this  or  that  electronic  model  can- 
riot  in  itself  serve  as  proof  that  4ust  such  a  system  of 
nerve  elements  exists  in  to  toin,.  It  is  well  known 
tto  one-  and  to  sa»  ertemal  effect  c.arx  be  acMe’ved 
as  to  x*asult  of  creating  different- radlo-electrcnio 


Certain  rules^  to  violation  of  which  may  result  In 
serious  systefflatio  'ei^rors^  mst  be  ©bse'rved  in  design- 
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I  ing  and  et-udjlng  oybe^netic  niodelBo  It  mst  Ibe  streBsed. 

I  ' 

j  that  the  model  a  conditloiied-“r-3flex  model]  can 

{ 

[never'  achieve  identity  with  the  ' biological  sjatem  imder* 

I  stiidyi  It  shonld  orJ.y  provide  a.n  emhodiiraBJit  of  tiie  p'rin- 
{'  .  '  '  ' 
i  ciples  for  Bt'o.dy  of  which  It  was  created,* 

f 

^  The  iBodern  theory  of  the  ''Isomorplilsjm”  of  different 
^  '  ■  ’  ■  '  ■ 

I  syBteiao  is  of  great  sigr.lfica?ice  in  app.lic5atton  of 


I BL'Milatlon  method^  I'hs  eorcept  of  the  "isomorphism,”  phe- 

t  ... 

I  norfie-nan  which  1b  set  forth  in  pai^tlouJai^  in  the  books 

'!  ■  -  ■  .  ■  ' 

||  by  I,  Ac  Poletayov  /52/  and  W,  Rose  Aehby  /60/  provido.B 

\ 

I  a  tihaoretlcal  baais  for  understanding,  the  complex  ln.te.r- 

I 

'  SN'-flationshlp.B  which  coiapound  om.  another  in.  Btudle.B  of 
"  the  brain  and  cybernetic  ffiod€:l.s  thereof, 

j  It  would  be  incorrect  to  suppose  that  pliyslcists 

I  ■ 

I  arid.  «iathemat:l.cla;n£  condticting  work  l.n  the  fl.eld  of  cy- 

i 

I  hernetlcs  ccn  solve  biological  problems  by  themselves, 

I  Mo  hiave  already  emphaaiL‘ed  tha.t  progress' can  be  achieved 

I  1.11  the  field  of  physiological  study  o.n.ly  on  comb5..nation 
f 

of  the  methods  of  p.by.slological  experiment  with  the 
itiethodB  in  wlch  corre sponding  rocudelB  ei’e  bi.iilt<,  The.rs*"‘ 
fore  o.ray  when  physlologistB  and  biochemists  possess 
the  technique E  of  modern  cybernetics  and  learn  to  use 
I  these  Kethods  of  inveutigation  creatively  in  solving 
I  See  p.ag-as  56'-58  '  '  '  ■ 


iii 
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;  Epeaiflc  problems  of  phyiSiolo^  siid  «»dlcine  ma^r  we  ex- 

1  '  JT 

tbe  declslr/e  t\a*ns  in  the  development  of  .the  so^.- 

r  '"  '  ■ 

■  enoe  for  'which  the  way  has  already  been:  prepared  by  the 
}  developifKSnt  of  radio  elsctx‘onics« 

‘  d.)  Nerrocybernetics  and  Stndy  of  tne  Brain 

I  Many  of  the  procoBBe-B  taking  place  in  the  c^rebrax 
i  cortex  have  been  studied  in  recent  years,  but  the  phy- 
i  Biological  nature  of  such  baaio  and  charac'fceristlo  phe- 
[  n.03Jiena  of  the  bralJi  as  the  thought  process.  Bmmrs't 
i  reriialiis  unlcno'wn^.  although  ttie  solution  oa  certain  pres- 

li 

\  sing  practiaal  problems  depends  to  a  considerable  deg»:*ee 

k 

1  on  progi^sss  in  tlie  sfady  of  these  problems, 

1  Ihe  brain  is  a  complex  system  ('’asseniblage’' )  of 

■■■  I ,  .  ■ 

[  nervous  elements  i^hlch  are  related  to  and  Imluenue 
i  each  other  in  a  special  manner,  Tte  most  complex  pat- 
!  terns  of  interac'fcion  of  a  very  large  number  of  nerve 
^  cells  arise  during  the  operation  of  the  brain,  A  masa'ic 
*  of  stiaulated  and  ^.nhibited  elementB  is  forvfied.  in  the 


I  process, 

I  j-|;  re-oently  becoKje  clear  tl'iat  the  sol ut ion  of 
I  a  series  of  pressing  probleniB  related  to  study  of  the 
brain  is  to  be  sought  In,  study  of  the  systems  ("oonstrAio- 
tio'ns’^)  formed  by  the  nerve  cells  and  tte'  physiological 
processes  ■which  talce  place  in  these  oonatructlons. 


MtmmirXL 
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I  l‘&  i{?  known  that  Snidlvidiml  nerve  elemsntB  do  not 
I  poEEass  the  r’cmarka'bla  prop^jr.ties  (thoiaifht,,'  i»j,aglnB;t;!..on^ 

K  _  . 

letc-„)  that  characteristic  of  the  'brain  as  a  '^sole^ 
i 

I  These  phenomiaria  arlEa  only  In  syatems  tlmt  integraite 

i 

I  many  thou  sands  of  nervous  element  b<,  Ifere  we  coma  up 
I  against  the  state  of  affairs  wMcfh  Is  Liora  clea, r-ly  ma:al~ 

i  '  '  ■  ' 

j  fented  in  the  operation  of  confuting  3ia, chines*  As  we 

I  . 

I  have  said^  each  of  the  eiemantE  of  the  eaaspiitOFj, 

i 

|,  a  radio  t'ube»  possesses  relat5.vely  simple  p.ropertleSa 

I 

I  Only  in  systems  whose  oojei>ositlon  unlfie-B  a  great  num- 

[  ber  of  sing^ilarly  interrelated  eiements  do  the  I'emark’- 

I 

I  able  p5.;’<>per tic s  inliierant  to  raodsrn  electronic  coEiimters 
j  ml'e  thc-ir  appe arcane e-** the  ability  to  play  chesSj?  trans- 
I  late  from  ono  language  to  stiotherj.  perform  complex  caloii- 
latlons,  etc« 

? 
t 

I  Ihus  the  problems  of  Btnd3>-  of  the  brain  are  found 

i 

■\  to  be  closely  related  to  analyBis  of  thB  ope-ratlon  of 

I  systems  of  Interrelated  olomorits. 

I 

I  T.ae-  diffioi.ilt1.es  encomtered  by  the  physiology  and 
pati-K^phjj'-Blology  of  the  brain  have  been  related  in  largo 
part  to  the  lack  of  sj/atemattc  sethods  which  would  per^' 
mit  an  appx*o.ach  to  the  solution  of  this  problem*  This 
important  clrcumstance'^-the  slgniflcanoe  of  which  tia.s 
I  'becoffira  fully  evident  only  recently-*-'!®  often  disrcigarcied* 


■r~ir-ini-nn  i  iiiftB-  iwn-itu- «!Merr48s>9Ms"ei%^«<i«*«a’(’.‘>'« 
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*rsroi»;** 


33 


ftn  tne  past^  phyelologiatB  hare  Bade  nmjes-otta  attsaspte. 
i ’  .  ■' 

[to  rippr-oach  tM  ntxi&j  ot  the  h^eSn  using  the  metliods 

i  developed  ahd  Justified  in  study,  of  the  Internal,  organs, 

[■niese  methods.  Involved  lrritatJ,on  of  isolated  s?or?es  of 
I 

I  the  brain  by  , electric  current  and  various  pfea-raimco-logt*™ 

f 

leal  agents^  removal  of  various  .areas  of  the  brain,  and 
I  the  study  of  the  Moelectrlpal  plienomm.  that  appear 
j  diu*ing  tJie  operation  of  tl^  various  r^r’vaus  eleffionte 
.and  groups  of  elements 

*j1io.so  p.yB'toJ'^iatlo  methods  of  iiive'Sti«5«iti.on  have  maxlo 
it  pcEBible  to  accuiiafi.ate  a  largo  voluaco  of  'm  and 
I  so3-?¥hat  disjointed  fact'oal  isatori.a.1  character-lrtiig  tli^ 
ope:ration  of  tte  brain^,.  but  have  not  led.  to  tlie  dls- 
I  cQvery  of  ii-ow  ps“l rAa5.pl as  and  mechsp.fi.sffls  i.r..  its  opera.- 
I  tion.,  The  lao'te  of  a  general  tIv?‘oi*y  for  the-  study  of  coiB'** 
I  T^lex  ey65>aES  has  fi’-equently  resulted  in  the  de^duc tJ.on  of 
^  erroneous  conclusions  on  the  baeiE  of  exporijsant  *  For 
exwxtplB^  some  section  of  to  brain  Is  remved  In  the 
course  of  an  espjortont;  to  oba.ngas  which  appear  in  the 
behavior  of  tl'xe  andrial.  are  Btodled  am  used  as  a  basis 
for  an  inference  as  to  to  function  ■l>orne  by  to  exo5..Eed 

i section* 

i  This  raethod  would,  be  valid  if  tl'w?'  brain  wej'^o  tin. 
inwohanloal  siimcfto  various  nerve  centers,  Aotolly*. 


nmset^ 
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I  ths  i^emoval  of  any  section  of  it  naj^  nesnlt  | 

I  In  changes  in  the  system  as  a  whole ^  ^  or  in  inhibition  f 
I  or  stimulation  of  other  Beat5x>ris^  and  the  's’eswlt  tmy  ' 

I  be  an  ahEerrahle  oliange  in  thB  operation  of  the  brain ^  i 

t  ■  ■  I 

j  Ine  03*10  mistsOce  can  be  isafe  In  eagiloying  tl'ie  techailq'uos  ? 

J  of  irritating  isolated  sectors  of  the  brain  and  picking  j 
i  off  bioelectrical  potentials  from  the  rarloiis  nerve  cen-  I 

i  .  ■  I 

5  '  :  5 

I  tors.  .  ? 


Since  it  was  diffimilt  at  tbs  time  to  predict  the  \ 

I  results  which  a  new  exporla^ntsl  technique  might  pr^O'-h  I 

I  -  "  '  ■»'  ■  h  ■  ■  '  ,  ’  :i 

i  aace>  che  potentiaj.  in  certain  isetbods  of  havestiga-  1 

^  '  -I 

f  tlon  was  considerably  overestimated.*  It  was  thouffiit  I 

If  ^  ■  '  'I 

(ajid  this  Is  still  mtalntalned  by  a  number  of  E^odern  j 

j 

pl'^siologistfi )  tiiat  it  would  be  sufficient  to  improve  ,  I 
the  experimental  technique  to  the  point  where  it  ms  I 

[  ,  ■.  '  .  .  '  .  i 

I  possible  to  read  the  biocurrents  fi-om  a  great  numlxu  I 

I  of  nerve  cells,  CDinbiiiiiig  tMs  method  with  that  of  | 

i  ■  ‘  ! 

I  icial '  stimulatl.on  of  sections  of  the  brain*  in  '  I 

I  ■  ■  ■  ■  ^ 

oroer  to  discover  a  way  to  recognition  of  the  basic  '  ? 

[  '  i 

j  laws  and  meohariisrrtB  of  the  brain!  b  operati.oru  This  1 

'i  .  ■  I 

I  idea  diverted  the  attention  of  the  Investigators  into  \ 

i  .  ■> 

an  exceptionally  le,borious  and  complex  ohanne^].  which. 

I  '  t  ^ 

I  as  has  become  evident  In  race'nt  vears,  dees  not  Inf-ti-  t 

I  ^  '  ,,1 

I  fy  the  hopes  attached  to  it.  '  i 

A 


As  a.  re-Bult  of  the  .emargc-nce  of  cyl>emetic»#  &ci*- 
entlstsj  have,  in  i»ec#nffc  je&TB^ '  scciulr-ed  expe'pienoe  in 
the  study  of  various  types  of  complex- systems* ' 
pests  for.  study  of  tlie  bratn^  aB  'sn  exceedingly  complex 
system;,  liave  iiaproved  at  the  sas®  time.  Possibilities 
for  m,ore  coxtr^ect  evaluation  of  the  vardcuB  «tM4g  of 
inyest:lgation  are  being  revealed.  It  hecb-ms  clear  tnat 
tiie  d5»fficultles.  related  to  study  of  the  brain  not. 
tecMI-oal^  but  fuxxdamental  in  nature^  and  that  they  can 
be  overcome  only  through  jaethods  of  etudyins  the-  brain 
as  a  complex  integt^atad  ■functional  system.  Even  thC' 
newly‘--developed.  Bie.'thodS'  of  investigation  involving 
Vi®-asux»effient  of  the  brain*  a  bioonx'rents  wltli  the  aid,  ot 
rrdcroelectrodes,  with  simultaneous  recording  of  the  bio 
currant-talJeeff  B^thods  cannot^  taken  alone solve  the 
baS'lo  problems  of  the  brain. "  b  physiology » 

V3  tsaagine  a  certain  ideal  case.  Suppose  that 
it  were  possible  to  mice  a  simultaneous  and  continuous 
recoil  of  the  potentials  on  all  nerve  cells  of  the 
i  brain.  In  this  vecovd^  the  petanti.al  of  each  cell  will 
I  be  registax’ed  independently  of  the  others.  In  this 
I  case  the  experiirsenter  Mould  ob'^i.ously  find  hlMKvIx  In 
i  the  position  of  a  man  trying  to  grasp  the  principle  of 
a  coxffputer  from  the' fllclcerlng  of  the  vacuum  tubes  and 
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i  the  operation  of  the  relays.  Such  a  problem  vitll  o'bviousl: 

I  ■ 

pT»o“ee  difficult  if  the  man  imacqminted  with  tlm  gen-* 
ieral  principles  of  the  operation  of  system.©  of  this  typo,, 

f 

I  Attempts  to  stiriMlate  isolated  element s—whl.ch  tm.y  be 
j  coiiipared  ■with  the  possibility  of  cutting  in  Individual 
1  tu'beg-™lead  to  the  same  result.  This  technique  may  lead 

5- 

I  to  the  discovery  of  ne’'^  facts  and  relationshtpSjj  but  can- 
!  not  yield  knowledge  of  the  basic  operating  principles  of 

I 

;•  the  By  s  tem., 

I  In  presenting  for  cojyparlson  a  system  consisting  of 

I 

!  I'adlo-electronic  eleirientB#  we  reaBoned  that  certain 

I 

I  principle,©  of  the  study  of  complex  systems  coiLld  be  11 
j  luctrated  more  clearly  using  this  eystsm  as  an  e,xii:®ple, 
i  Thu.c  it  becomes  more  and  more  clearly  neoeBsary  to 
\jse  methods  of  inve  ©tigatlon  which  permit  the  study  of  . 

I  the  brain  to  be  apprcaclied  as  that  of  a  complex  fane- 
tional  -system,. 

As  we  know,  the  development  of  the  objective  method 
of  studying  higher  nervous  aculvity  by  I,  P,  Pavlov  and 
his  students  has  been  of  decisive  significance  in  the 
study  of  this  problem,  Ilie  basic  prlnclple.g  of  this 
msthod  are  epaite  familiar.  It  consists  essentially  In 
applying  certain  definite  disturbances  and  different 
complexes  of  disturbances  (complexes  of  Bti.ffl:ali)  to  the 
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. . . 

’  iv;»a:Sr  In  tha  cjoupse  cf  the  e3?>erlment  and  studying  the 

I  ""  ■  '"  ■ 

1  '!?-e--VtonBQ'&  of  the  systes.  to  these  atiisull, 

! '  .  ■ 

I  Tills  R'iStliod  may.  he  used  to  reveal  the  genex-al 

!  rules  (algorithms)  of  tlie  hraln^s  operation  as  a  func- 

I  .  . 

!'  tlonal  system.  It  ififikes  it  possible  to  Include  any  com- 
( 

f  plex  of  signals  in  the  experimental  procedure  and  to 
I  taJce  into  account  precisely  both  the  nature  of  tlie  set 
i  of  stimuli  and  the  natui-e  of  the  animal's  corned, ex  re- 

i 

;  sponses.  Thus  it  opens  bi>oad  vistas  for  scientific  analy- 
f 

I  , els  of  the  phenomenon  under  study, 

I  I.  Pa  Pavlov  discovered  the  basic  rules  which  lead 

f  to  the  formation  of  new  conditioned-reflex  reactions 

!  ,  ■ 

I  and  to  the  disappearance  (inhibition)  of  temiporary  as- 

I  sociations  fomed  earlleru  These  rules  are  well  knov^n, 

I  It  must,  however,  le  stressed  that  the  nature,  of 

1  t'i'O  brain-activity  x*elationships  noted,  in  the  course  of 
\ 

I  the  experiment:  depends  to  a  major  degr^ee  on  the  nature 
1  and  .complexity  of  the'  com,plex  of  disturbances  which 
I  the  experimenter  has  applied  to  the  brain  In  the  cour&e 
of  the  experiment.  Wien  this  problem  was  first  studied, 

.  a  relatively  sl.raple  form  of  e.™rlment  that  enabled  ub 
to  di-BCern  the  .laws  of  formation  o.f  rBclateci  conditioned 
reflexes  was  employed.  However,  the  g,rea.t  significance 
I  of  I.  P,  Pavlov's  discovery  lies  in  the  very  fact  that 
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.  ■»  . .  ^  - 

;■  it  gives  general  princlpleB  which  form  a  basis  for 

j  furthe-r  development  cf  this,  field  of  inquiry,  Fr^'oceed-* 

I  Ing  in  the  direction  of  more  complicated  sets  of  ex- 

I 

I  periiiiental  dl  stnrbances.,  the .  experimenter  has  the  op- 

I 

i  porturdiy  to  stixdy  lncre.a3lngly  coiKplex  systems  of 
I’ miles  (algorithms)  governing  trje  operation  cf  the  brain, 

I  In  this  connection,  investigations  carried  ort  in 
'(  recent  years  in  which  more  comple  x  systems  of  disturb- 
1  ance,3  have  been  employed  and  which  have  led  to  the 

t 

) 

I  developm.eiit  not  cf  single  conditioned  reflexes^,  but 
f  . 

I  coj^'plex'  systems-  of  condittoned-'reflex  reactlonSj,  ha-ve 

I  acqui-red  great  slgnif5-cance  /1^12bl-4jl5>19i'‘-C>21#  3rjr55/» 

I  The.-  problems  of  study  of  the  brain  are  closely  re- 

i  lated  to  thj-^  group  of  concepts  .studied  by  cybs-rnetics 

in  corinectlon  with  the  ’’black  box”  p-rol>lem.  Here  it 

I 

i  must  be  noted  that  we  spaal^.  in  tills  case  of  study  of 
j  a  higtily  complex  ’’black  box”  which  not  only  shows  cer-  . 

I  tain  types  of  r-e spouse  to  various  signal  complexes  but 
!  <;an  also  modify  itself  uMer  the  Influence  of  the-se  sl.g- 

t 

I  nals„  Hits  ‘black  box”  has  a  vast  number  of  inputs  and 
outputs  In  the  form  of  receptor' and’ effector  nerve  cellSj 
and  each  of  the  disturbances  entering  ttie  central  ne'rv-c:.us 
;  sy stem. or  going  from  it  to  the  periphery  encompaese,3  a  • 
I  complex  system  of  Inputs  or  outputs. 
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I  Bi''Osd  new  pnoepectfs  Tor  Investigation  of  the  fcr*aln  | 

I  '  ■  ■'  ■  ^  .  I 

I  are  -unfolding'  as  a  result  of  the  recent  aehle-veraents 

I 

I  of  cyljtrr'netlcfiii,  and  of  the  de-velop^ent  of  neitrocjbernetlcs  ; 

'  ■  '  I 

;  In  partj.cular,  Cyhemetics  worKs  out  methods  wntch'  per-  | 
f  .  ■  ■  ; 

(  mlt  UB  to  approach  the  Investigation  of  coi^^plex  sy-Btcmis 

{  and  thereby  overcoiRee  a  -s-eries  of  formidable  difficulties  ^ 

l  ■; 

I  in  the  way  of  in-?estigatione  of  tlio  bi-^aln^  ; 

i  '  -  '  '  '[ 

5  Aa  a  science  possejsaing  specializod  tecimiqueE  of  ^ 

\  investigation  and  having  itgj  OMn  range  of  problems^.  s 

i  .  ^  'I 

i  nct^rocybornotlcs  cannot  embrace  all  aspects  of  the  j 

I  brain ^5  operation*  In  partlmilar>  it  does  not  oonElder  ■/ 

I  "  '  'I 

I  the  various  specific  forms?  taken  by  the  migration  of  | 

C  '  ■  ■  ■' 

j  matter  ar^d  lying  at  the  fo-andatlon  of  the  brain* a  ac- 
I  the  complex  bloelectrlcal  phenomena  and  proces-  . 

{  -  '  ■  •  i 

\  ana  related  to  the  ex.oimTtge  of  nmtter  and  ©nergjy  reriiain  | 

?  ■  i 

f  o'Utsida  its  field'  of  vision*  The  p-ubject^-matter  of  cy-  j 

;  ,  ■  ■  ■  f 

!  bernetlos  is  fermed  chiefly  by  the  corRplex  Biecbantsms  of  I 

\  '  I 

f  information  processing  and  co^itrol  whicii  are  at  woric  In  | 

I  tl'ie  brain.  These  processes  ai-e  related  to  the  functioning  | 
of  complex  systems  consisting  of  large  numbers  of  mrve  > 

i  I 

I  cells,  related  to  one  another  in  a  speclJil  way*  f 

I  •  '  ■  ! 

J  Two  basic  directions  of  InveatigatiDn  may  be  dis-  | 

I  tlnguished  in  studies  of  the  brain.  The  first  is  con-  j 

i  earned  with  study  of  the  general  z^latlonships  (algor:r- 


m«ci  i«juj*W«r  Bif  ~'i'r*nT« - r— ’f~  . . .  . 


itlariE)  cf  the  bi’ain^s  oper-aticn.  The  second  task  is 

i- 

i 

f  study  of  the  pliysiological  ineohanisiKS  of  its  operation. 

If 

j  AE  we  have  already  said,  the  first  of  the  problems 

I; listed  above  can  he  studied  successfully  on  the  basis  of 
'the  methods worked  out  ty  !♦ .P,  Pavlov. 

'  The  .atta.lnrn£;ntB  cf  neTjrocybernetics  aiT;  opening  new 

f 

(prospects  for  the  Investigation  of  this  problem*  Th©  cleY- 

f 

Ulopment  of  a  general  theory  of  S8lf*-organlE5tng  eonbrol 

V 

;  systemE  makes  possible  a  broader  approaon  to  the  problem, 

I  of  study  of  the  brain  he  operation:.  It  becoKie  e  poBSible 

i  "  ■ 

t  to  oonside;©  the  complex  system  of  Inters, ctiors  tlist  ar'ise 

\ 

i  between  the  brain  and  the  external  medium^ taking'  into 
I  account  not  only  the  influence  of  various  complex  of  e»- 

i' 

I  ternal  signals  on  the  brain^  but  also  the  changes  which 

i  the  organism  introduces  into  the  medium  surrounding  it*. 

I 

i  In  the  study  of  this  problem  it  is  found  neoes.sary  to 
I  use  a  series  of  specific  msthoda  of  Investigation^  and 

i  the  S'imulatlon  method  in  particular.  This  problem  will 

\  '  ■  ■  ■ 

i  'be  considered  in  detail  In  Chaptere  IV  and  Y1  of  the. 

! 

I  present  worx. 

i  The  methods  cf  neurocybernetics  are  also  of  great 

i 

I  value  in  study  of  the  second  of  the  problems  listed. 

1  above.  The  cp^etion  as  to  the  mechanisms  of  operation 

I 

,|  of  the  brain  is  one  of  tba  moEt  complex  of  q.'feetionE.<. 
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..Foi*  a  study  of  this  problem  'It  is  iTtecessai^  to  •desoribe 
i  ^ 

fin  greater  detail  the  basic  nile  (algoiaithm)  of  tte 

f  .  •  ■  ■  .  . 

fbrairJs  operation^  since  without  a  'fflore  or  less-  eoapiete 

|descr'lpt.ion  of  the  basic  prdnoipie  of  ■operation  of  the 

Sevstem  it  Is  difficult  to  create  producttw  hypotheses  . 

I  "  . 

f concerning  the  prliic?lple  of  its  internal  iPscIianiSM*  As 

|we  have  noted,^  definite  roEults  have  been  obtaS-ned  In- 

I 

jthis  respect, 

I  The  d.eveiopment  of  a  theory  .of  the  nerve  r.€two3r*k 
I 

I  is  an  important  achievement  of  neurocybernetics  (the  priri- 
Icipal  points  of  this  theory  are  set  forth  i.n  II  • 

and.  .lA" } » 

In  the'  first  stages  of  study  of  the  brain^i  when 
•srbe  investigator  is  dealing  with  relati'vely  simpl-e  fo-rms 
of  its  activity#  physiological  artalysis  of  the  facts 
asoertainod  maj’'  be  based  on  eons idex*at ion  of  the  scheme 
of  the  simple  i»eflex  arc  of  a  single  conditioned' reflex. 
Later#  however#  in  analysis  of  the  phenomena  which  arise 
in  complex  systems  of  motor  condit5.oned  reflexes#  .this  ap¬ 
proach  iB  no  longer  adequate.  It  becomes  neoesBary  to 
pass  on  to  consideration  of  nerve  networks#  systems  con- 
si,  sting  of  vez^''  large  .nuHl>ers  of  intercomected  nervous 
lelemcnts#  and  to  oonsideration  of  the  procesBes  which 
iurxfold  in  these  syatem.s..  In  the  oom’-se  of  such  &n  exsj>.- 
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•3,.nationi,  it  Is  found  neceBoary  to  use  the  sura,  total  of 

I  .  .  ■  ^ 

llnfonnation  negar-'dlng  eystems  of  nez^ve  elements  wbi.ch  is 


[at  the  preaent  tliwe  at  the 


,1  of  the  network  tiiocr;?. 


'thiis^^,  “toe  nerve -’network  tlieory”  wMch>  of  course#  cannot 

I  in  itealf#  In  isolation  froir.  physiol oe:lcal  experiKents# 

^  ■ 

‘lead  to  conclusions  ooncerning  the  mecdianlssriH  of  opera,- 

Ition  of  the  brain#  can  play  an  Important  part  in  the  eolu- 

I 

Itlon  of  this  pr*oblem. 

\  As  we  know#  one  of  the  bases  of  this  eiX.simlnatlon  is 

I 

ithe  assumption  that  nervous  elements  may  have  a  certain 

I 

j excitation  threshold#  with  the  I'esult  that  they  ooto  into 

I 

I  a  state  of  excitation  only  when  several  impulses  arrive 

I  slrnultaneouEly  at  nerve  cells,  TMs  prdnclple,  which  has 

\ been  confirmed  as  a  result  of  physiological  study  of  the 
i ' 

j  work  of  nerve  ceO.lSir  enables  us  to  pass  to  analysis  of  more 

i 

i 

I  complex  phesnomcuja „  On  this  basis,  we  my  visualis:;©  a  nerve 

I  network  wM.ch  poBsesses  fche  capacity  to  keep  tmck  of 

I  the  number  of  incoming  impulses#  to  coinpara  different  com.- 
I 

|plexes  of  stiimili  wi'ch  one  anothei}  and  to  detect  the 
I  moment  of  ccincldenoe  of  two  signals.  One  possible  struc¬ 
ture  of  the  nerve  network  on  the,  basis  of  which  oondl- 

tioiiGd-re.fle.x  chains  are  formed  is  presented  in  Chajjter 

I 

|V1  of  the  present  work.  Such  systems  may  in  fact  exist 

I 

fin  tte  brain,  so  that  there  1b  no  basis  to  proceed  only 


•(anje»tx- 
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sWWvtKTJniWi:': 


i  from  the  system  of  the  simple  i^flax  arc  in  otir  theore~ 
tlcal  exa'mi.ns,tio>j  of  the  physiological  mechanismsc 

It  should  'be  noted  tlmt  although  the  nerve- ne  fcwork 


j  theor-s?  seeifts  at  first  glance  to  have  developed  inde- 
[  pendently  of  phyBloiogical  experfment.^  such  a  ripjtual 


[  relationship  must  uiidoubtedl.y  exist*  Experimental  denh-  \ 

f  f 

I  onstration  of  the  existence  of  new  complex  foi^ms  of  I 

I  ■'  '  '  '  .  I 

f  the  brain *B  operation  poses  new  problems  in  the  develop-  I 

i  ■  '  ■  I 

*  ment  of  fhe-  principles  underlying  the  structure  of  tlie  | 

s  i 

J; 

i  nerve  networks  at  the  foimdation  of  tiie  newly  observed  5 

f  •  -I 

(  properties  of  the  bra’inls  operation,  I 

>  J 

r  .} 

I  ’.rneae  problems  must  be  worked  out  In  close  ocm-  J 

I  -'  I 

binatlon  with  physiological  experiments  on  aniriials*  I 

Physiological  ex,periments  maice  it  possible  to  break 
down  such  complex  plienoviena  such  as^,  for  example,,  the 

f  .  V  "x 

^  ‘'concept  formation”  phenomenoii, eta,  into  their  simple 
1  I 

I  I 

i  comroonents,  | 

^  *  I 

Tlt'i.e  nerve  networks  can  be  worked  out  cn  the  basis  f 

* 

I  of  the  experimental  investigation, 

♦ 

j  The  creation  of  corresponding  radlo-eleotronlo 

I  models  may  be  of  great  value  In  conducting  this  work, 

I  The  creation  of  a  model  may  confirm  the  validity  of 

I  the  system  of  presentation  which  has  been  wox^ked  out, 

I 

I  ¥e  encounter  the  problem  of  finding  ways  to  dem-- 

! 
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.  crt3i;rate  trie  identity  of  iche  hypotheses  advanced  on  f 

f:  '  i 

I  this  baale  to  the  specific  Btiniot-uces  of  nen/ous  els-'  i 

I  ’ 

;  n'erits  functioning  In  the  brain, 

i  i 

I  It  1b  poaslble  to  woiic  out  several  nerve-networfr  | 

'  I 

:  arrangeiiierits  which  provide  '  sliailar  external  forms  of  f 

I  tl'ie  syscorafe  operation*  It  can  also  be  aatumed  that  I 

i 

!  Boino  other  tviie  of  structure  based  on  otljcr  as  yet  un-  f 

^  I 

I  known  principles  are  used  In  tlie  operation  of  tbve  brain*  I 

t  ■  '  '  '  ■ .  I 

f  Although  we  ac'kno'Wledge  the  difficulty  of  solving  t;his  | 

1  ■  J  ' 

,  probl€.ni«  it  should  be  stressed  thcat  it  Is  not  i.nsolublo,  j 

I  I 

I  ,  Even  now«  we  can  outline  certain  path®  to  tha  eoXji**  | 


f 

I 

i 

I 

'! 

S 

'f 

I 


i 

i 

I 


if 


tion  of  this  probleia  which  havol  been  used  S'Uc<scEpful2y 
in  other  branches  of  human  knowledge-  (in  chemistry,, 
phsrsi.cs..  etc*)„  Hilo  method  Involves  advancing  sevveral 
hypotheses  and  then  designing  experlmtentB  which  will 
reject  one  of  the  hj^potheseE  and  confirm  another* 

l)  In  studying  two  or  more  different  nerve -network 
S3?-st€mSj  we  may  find  certain  specific  conditions  urmler 
which  they  will  not  behaX''e  identically*  In  this  case 
we  may  set  up  a  special  experiment  which  will  show  how 


it 

I 

I 

t 

I 


t 


I 


I 


i 

I  the  brain  belxaves  under  given  conditions „  This  experi 
I  ment  will  enable  us  to  reject  one  of  the  hypotheses 

j 

I  and  confirm  the  otlier*  Such  a  metiiod  of  investigation 
I 

j  is  widely  xAsed  in  chemistry'  when  reactions  of  a  com- 

f 


po-and  -Kith  other*  subistanees  m*e  studied  in  o'rder  to 
confirm  a  new  bypotheslB  eonoerning  a  structu3?a,l  for¬ 
mula.^ 

2)  In  sfc-adying  one  of  anothei?  hypothesis  regard •« 
ing  the  structure  of  &.  fxevv.e  network*  it  rm-j  be  found 
possible  to  pF-edi.et  definite  forms  of  behavior  of  the 
given  system  In  new  elttiations.  If  the  experiffi'ant 
confirms  the  assumptions  made  and  we  thus  ff-ucceed  In 
predicting  new  phenomena  on  the  basis  of  the  theory 
then  the  theory  acquires  a  right  to  exist, 

3)  Tlie.  posBinillty  of  accounting  for  a  large  num¬ 
ber  of  prevdously-descr-lbed  factB  ustmlly  acquii'es 
great  significance  In  confirming  the  validity  of  a, 
hypothesis.  Quite  oftery'  an  intuitive  conception  of 

a  theory  m  ’’ fully  valid”  Is'  formed  without  real  di¬ 
rect  Pi'oof,^.  on  the  basis  of  the  fact  that  it  explains 
many  obsorvatlons  which  bad  not  been  explai.ned  p3>ev- 

iously.  . 

4)  Various  methods  of  study  of  the  brain  involv¬ 
ing  stlmalatlon  of  its  various  aectorSj^  extirpation^, 
the  reading  of  potentials  fr^om  .various  sectors.^  etc«^ 
may  be  used  to  confirm  or  discredit  various  hypotheses, 
'liiese  laethods  may  be  of  value  If  they  are  xised  t-o  prove 
or  disprove  hypotheses  which  have  already  been  foinBu- 
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:  lated« 

j  5)  Study  of  the  moi^phologica]-  structiDr^  of  the 

i  brain  es  well  as  analysis  of  yariouB' cases  of  damaged 


sectors  of  the  brain  in  coiinectlon  with  SuUdy  of  fUiio~ 
tlcnal  dlst-urbanoes  my  beef  great  vslIuc  in  the  con- 
f5-nK53tion  of  a  hypothesis,  _ 

At  the  present  time  the  complex  pattern  of  the 
brain ^s  stinj-cture  presents  a  mystery.  If  a  hypothesla 
were  ■  ereated  which  accoiinted  for  all  of  the  peculiari“ 
Itlea  of  the  arrangement  and  stinxcture  of  the  n&v^'e 
centers  In  the  brain  and  the  specifics  of  tlie,  functional  • 
dj.sturban.ces  which  occur  when  they  arc  such 

a  hypothetic  would  obrlously  be  highly  valuable  and 
would  be  regarded  as  siifflclently  authentic, 

6)  Tiia  criterion  of  practical  applicability  Is 
Che  final  conflmfition  cf  tte  validity  of  a  theory'.  If 
a  method  of  analy^rlng  the  activity  of  the  brain  which 
we  have  described  leads  to  progress  in  explaining  the 
causes  of  its  illnesses  and  assists  in  the  solution 
of  certain  technical  problems  then  It  1ms  obviotisly 
acq'u:l2‘*e‘d  a  right  to  exist. 


'fbuE  the  problem  of  deiflohstrating  validity  of 
this  or  that  hypothesis  is  not  an  insoluble  one.  At 
any  rate^  mention  of  th©  difficulty  of  demonstrating 


4'7 


^  tbs  validity  of  hypothe.^ee  carinot  be  taken  ae  a  wexgnty 
I  ar'g'ajnent  a|i,.aiiist  candying  out  wori-c  In  this  ol.reotion^ 

^  e  ^  IJe'Li:r‘o.eTbeMie'tlcs  and  Patho-physl-ology 

f  !  - 

I 

j  The  Bt^idy  of  the  causes  of  illnesses  and:  thein 

I  jjathophysiologloal  mechanisms  is  closely  related  to 
!  study  of  complex  syaterfis  In  ■which  control  and.  infox'— 

I  ' 

I  iTiatlon<«p.roceEaing  mechenisme  are  in  e'^idence*  Here  ■v'fe 
I  consider  not  only  the  fimctlcnlng  of  the  systems  In 
i  their  ixormal  state  but  also  the  yarieus  foras  of  dlB-- 

I  '  ■ 

I  turhaxxce  a/nd  deviation  of  the  cont.t*ol  and  regula.  i/ion 
1  pinocesses,.  As  a  result  of  this#  nem»ocy hornet ics  Ms 
{  recently  requlx'ed  central  slgntf loanee  for  tha  study 

i 

I  of  pathophysiological  pro'blejtis, 

>■  *- 

Methods  of  investigation  involving  diEne:mberment 
of  complex  proceBsea  into  tMir  compoxient  parts  and 
\  the  appllcatlox).  of  disturbances  to  these  Isolated  ele- 

I  '  ' 

I  ments  of  the  s'ystem  have  been  xxsed  exte*ns,ixoely  in  the 
I  study  of  pathclogical  phenomena,  Just  as  in  physiology. 

I  Here  the  f»mdamental  logic  behind,  the  investigation 
jTrequently  reduces  to  the.  folloxfingt  I'f  'the  rem.oyal  of 
an,  organ.,’  the  aevering  of  a  nerve  tmnilc.,  or  the  arti¬ 
ficial  inhlbit-io’n  of  a  process  Ms  raBulted  in  the  dis- 
I  appearance  of  the  .symptoms  of  the  illness  j,  it  is  con- 
I  cl'u.deci  that  the  eliminated  factor  wa.s  the  cause  of  the 
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i  nine  EE  In  qneEtion.v  On  the  other  hand.  If  the  intro-  f 

I  n 

I  duction  of  a  Eubstauce,  the  stlriialation  of  a.  nerve,  I 

I  ,  ■ '  ^ 

i  or  the  transplantation  of  an  organ  has  re Halted  in  , 

I  the  appearance  of  S3?'E)pto)nE  of  an  Illness,  then  this  | 

‘  conld  be  regarded  as  a  bsisis  for  the  advancement  of  | 


■  a.  new  h/nothesia  concerning  the  causes  and  mecIianismH 


of  development  of  the  pathological  state  in  question. 


NiT’nerous  hj/po theses  ecncerning  the  causes  of  111- 


f  nesseB  have  been  foi’mulated  on  the  basts  of  sTJch  in- 

f 

f 

!  fox*mation  and  new  inethods  of  nreatiiient  devised*  For 

I 


S 

\ 

I 


I 

I 


I 

u 


j  example,  rintiei'ous  liypotlieBeg  hitve  be:-en  advanced  on 

i  the  csAises  of  hypertonic  disease,  which  are  reltited  to 

( 

I  disturbances  in  the  operation  of  the  kidneys  and  de¬ 
pressor  nerves,  hunioral  imbalance  tn  the  composition 

;  of  the  blood,  dlstm''bance  of  centers  in  the  brain, 
etc,  Tlie  corresponding  methods  of  treatment  fooused 
on  these  organe  (for  example,  removal  of  sympathetic 
ganglia)  have  been  worked  out.  However,  it  subse¬ 
quently  developed  tliat  all  of  the  factors  that  were 

I 

I  stiidied  are  merely  individual  links  in  a  complex 

t 

I  syBtem  of  proeesses,  and  that  methods  of  healing 

! 


i  based  on  itiethods  of  treatment  of  thc^se  links  are  not 


I  sufficiently  effective*  Thus,  for  example,  neither 

I 

I  the  removal  of  B^/S-’^PS-thetic  ganglia  in  oo,ses  of  hyper- 


•mitf.'net 
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tordo  disease j,  nor  tl^e  reinoval  of  parts  of  the  Btomaoh  ■ 
in  cases  of  ulcers^  nor  the  removal  of  the.  thyroid 
gland  in.  cases  of  hyperthyi^oldlsm^  has  produced  a  per^ 
Kianant  cure  of  tiie  illness^  In  our  opinion^  the  cause 
of  the  illiiess  in  all  these  cases  has  heen  a  general 
dtst:irbanee  of  the  coraplax  control  and  regrulation 


i  fimotions  of  the  organism.  Treatment  of  one  Unit  of  a 

I 

r 

I  complex  aystem  of  processes  has  not  resiilted  in  resto- 


i 

\  ration  of  the  oyer*-all  regulatory  processes  nor“  In 
I  ■ 

I  the  disappearance  of  the  illnesvs.  From  the  st.a'ndpolnt 

I  - 

I  of  the  general  theory  of  functioning  of  a  systemuthe 
Infliienoe  of  some  one  factor  on  the  p.athologlcal  prO“ 
c®s.s  cannot  serve  as  a  proof  that  pre-cisely  this  fae“ 
tor  is  the  oause  of  the  lllnesa  £i.nce  it  may  'be  only 
one  of  the  linlcs  In  a  system' of  processes.* 


V 

i 


1 

i 

5 


SoiiietlKies  the  method  of  treatment  adopted^,  al- 
though  It  does  produce  temporary  relief  .from  the  symp- 
does  not  retard  the  patho¬ 

logical  process  as  a  vjhole*  Thus,  for  example,  when 


It  was  concluded  that  a  towered  concentration  of  thy¬ 
roid  hormones  was  re-Bponslble  for  myxedema  while  a 
lowej;’ed  concentration  of  Insulin  was  responsible  for 
Svigar  diabetes,'  tha  method  of  treat5..ng  these'  Illnesses 
I  involved  Injection  of  .the  substancsB  into  the  blood  of 


2’ 


I 


I 

t 


i 

f' 
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I 


;■  the  patlent—a  coiirpe  of  action  wh5.ch  lefi  to  tempoi^at'y 

f  ■  ■  ■  ' 

I  i»elief  of  the  eymptcms  of  the  illness  and  the  Euffer- 

I'  • 

i  Ing  of  the  patient  .'which,  of  ccimse.  1^5  of  great  ?35,g*- 

I  niflcance  fon  the  patient.'  In  the  opinion  of  A^h'by  /59/» 
i 

f  honevex^  this  method  tt’eatment  doe.E  not  rem-Ov'e  tlie 

!  '  '  ' 

i  p.a'thologi-cal  condition  as  a  whole,.  Ihe  c?-mse  of  the  ill- 

i  ' 

I  nosf;  consists  In  a  dlstiinhanee  of  the  general  prone sses 

I 

i 


i  of  control . 

j  Thus  it  he  comes  more  and.  mo.c^  clearly  necessary 

I  to  Et-'ddy  Illness  from  the  v^levipolnt  of  the  general 

I  tiioory  cf  functioning  of  systems,  and  to  recognisio 
i 

S  tlio  Importance  of  the  general'  t.lieory  of  control  a,s 
I  well  as  to  develop  metnods  of  Invest Igat ion  which  will 
ma-Uee  it  posslhle  to  appi'caoh  the  study  of  Illness  as 
a  comple?:  syste'mi  of  processes, 

1 

I  Here  the  ■werh:  of  I,.  F,  Pavlov  is  of  great  slg- 

I 

j  niflcance,  I,  p.  Pavlov  regai^ded  illnece  as  a  com- 

1  plex  system  of  processes  in  '4nlch  the  dlsplaceM,ente  due 
1  .  ^ 

I  tO’  the  action  of  the  pathogenic  agent  itself  and  those 

I 

I  d-ae  to  the  operation  of  p>roteGtive  comperiSat.lng  raech- 

i  .  , 

I  anlsms  are  clo.Eel;."  l.nte proven.  Here,  a  m.a.'lor  role  is 

I  ascribed  to  the  ne.rvous  system. 

I 

j  Favlo'V'  advanced  the  highly  important  view  th.a;t 

f 

)  t.he  'veic-  sarac-  control  -systems  and  processes  ^fbich 

» 


I 

I 

I 

i 

i 

] 

i 

1 

) 

i 

i 


■i 

! 


j 

* 

i 

I 


i 


I 

fi 
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6 

r  under-'  noraal  conditionB  are  of  great  adaptlrre  or  pro-  | 

f  I 

I  "  ■  'i 

I  te-ctlre  value  may  lie  at  the  roots  of  an  illness^  These  | 

V  ‘ 

j  mechantsaia  are  e^cprassed  liypertrophlcally  imder  certain 
i  oopcHtlonS  and  "becomie  the  basis  for  developiTjent  of  an  t 

I .  ■  ; 

I  rllneBii*  For  example^  the  physiologloal  aiechanisms  j 

I  ^/n-iioh  oaiise  an  incr’oase  In  .blood-presBure  level  during 
I  a  period  of  danger  are  of  great  significance  In  the  ^ 

1  Ilfs  of  animals,  since  it  is  necosgiary  during  periods  •  ; 

I  ^  . .  I 

I  of  danger  to  assure  an  abundant  supply  of  blood  to  the  i 

I  inu soles  to  isupport  tlielr  Intensified  operation  (In  com-  .  | 

bat  with  the  enemy  or  In  flight).  As  ha®  been  noted  by,  ^ 

I 

G,  FI  Lang  /3Q/»  however’#,  these  very  raechan:lBffi.s  for®:  , 

the  basis  for  the  developsent  of  hypertonic ■ illness^  4 

Tl-ie  work  of  PavloY  /5V  students  ’  | 

I 

and  disciples  /5#15^ 28#48/,  who  showed  that  the  | 

development  of  systeraa  -of  pathological  conditioned  | 

* 

reflexes  may  fona  the  bESis  for  the  developjiKjnt  oi  an  | 

j 

llJncsp.  hsve  been  of  great  significance ,  This  lairor-  i 

tant  adaptive,  pixy  Biological  lacchanlssi  w  also  become  | 

'  I 

the  basis  for  the  development  of  a  pathological  con-  I 


I  dition* 


I  Tl'Ae  rapid  developrasnt  of  corxditloned  r€3 flexes  | 

I  .  ■  'f 

i  connected  w"ith  danger  to  the  life  of  tncs  ana-Hial  I 

i  .  ■  '  '  I 

I  "be  of  are  at  adaptive  value..  Under  certain  conditlonss-  | 

B  ‘  '4 


lifatuMfiC: 
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.  homvery  theae  sa^ae  ineshanlsma  macv  becoiiie  the  baslE  t 

I  f 

I  for  ti'ie  (levelcpment  of  a  pathologloal  at&te  of'  the  or-  f 

I  ganlatm  /2!'S^15^l6^47/*  A»  a  ooK.8e<jt£enc0  of  ths-  very 

I  simpl?.city  aii<3  eaoe.of  'formation ■  of  them  refl.e;«es,  ■  j 

I  they  raay  beooms  the  oauee  of  a  pei'mnent  alevatlon  of  i 

I  tlie  blood  pressure*  ,  .  ,  | 

1  ’  ,  I 

Mecha^nifi^ma  Bi.milar  to  these  for?».  the  ba^is  for  | 

development  of  certain  diseases  of  the  gastro-intestlrial  I 

■  tract,  arid  other  pathological,  states,  lliese  are  also  I 

.  ,  .  ■  I 

nasea  on  adapti'^.^e  re-actlons  which  prevent  poisoning  of  'j 
U  the  organtGin  when  toxic  substances  are  tal?:en  into  tiie  | 

I  stoiaaoh  (for  exaniple_j  V02ait5.ng  i*eflex),  Tiie  capacity  I 

1  *  I 

I  fcr  I'^apld  development  of  appropriate  stable  Co.nditioned  j 

2'’silexe:a  is  of  definite  value  for  tlio  p?*evention  of  | 

poisoning*  However,  even  these  conditioned  reflex  reac-  I 

i  tions  maj^  under  certain  conditions,  form  a..ba35.e  for  | 

the  development  of  an  illness.,  | 

I 

I  Bi'oad  new  prospects  have  bean  opened,  for  patho-  I 

f  ’  ■  .!' 

I  logical  pt^siolo.g,/  as  a  i^esult  of  the  developu'sent  of  I 

I  cy)>emetlc® ,  As  noted  by  Ashby  /59jr60/,  cybernetics  | 

j  creates  a  .ge.neral  theory  of  the-  operation  of  .coujplex  j 

I  control ,  systeiH-s  and  it  provides  rtew  techniques  for  I 


the  Investigation  of  complex  .ays  terns.  As 'a  re  suit  it 
.'beeosnes  passible  to  pass  dli^ctly  from'  the  study  of 
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Isolated 'links  and.  symptoras  of  disease  to  the  crea¬ 
tion  of  an  integrated  piotiii^  of  It®  pathogenesis  and 
the  detection  of  th^i‘  real  causes  of  its  .appearance , 

T.he  solu.tlon  of  this  problem  will  be  found  possible 
cnly  when  the  scienti.flc  ^?ol^kars  working  in  various 
branches  of  p.atho -physiology  have  inastered  the  basic 
techniques  of  cybernetics  and  learned  to  apply  these 
methods  crea.tlveljr  to  their  fields  o.f  investigation* 

It  would  be  incorrect  to  assuae  that  t-hi,a  problesi 
can  he  solved  only  by  physicists  or  rfiath.ematlcia.,xis. 

¥s  have  had.  an  opportunity  to  consider  the 
question  of  the  ro.lo  of  cybernetics  in  the  Etiidy  of 
mental  illnesses  /Ifi/*  Xn  the  present  work  we  sbvall 
da’j'ote  attention  only  to  cert.airi  general  problerstS  o.f 
the  use  of  neur-ocybernetics  in  patho-physiological 
studies*  We  feel  justified  in  making  the  assartian 
that  the  difficulties  encountei^d  in  the  study  of  a, 
whole  series  of  lllnesBCE  (hypertonl.a5  stOBiach  ulcerE# 
etc*)  stem  the  fact  that  we  know  as  yet  very  lit¬ 

tle  concerning  the  comples  regulatory  rnechanlamB  and 
the  complex  control  processes  'which  are  at  work  in 
the  normal  organism. 

States  of  the  system  In  vyhlch  a  change^  in  one  of 
Its  processes  (component  A)  results  In  a  vxhple  series 
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:?  -vsWK 


i  of  dlsplaooments  in  other  fjyatems  with  the  final  re-  t 

anlt  that  an  Influence  arise a  which  Intensifies  componenc  I 
I  A,  intensifies  the  pi^cesa  which  gave  rise  to 

i  the  rciaetion,,  apjyear  to  us  to  of  great  fsigniflcanoe  j 


in  the  development  of  pathological  conditions*  Closed 

I  ‘ 

i  sy sterna  with  positive  feedback  arise*  The  functioning 
J  '  ■ 

;  of  auch  systems  has  by  now  been  thoroiighly  studied* 

I  In  our  speci.allaod  work  /15/  we  Mve  attempted 

] 

j  to  point  out  ways  to  the  Investigation  of  such  a  sys- 

i 

I  tern  in  the  development  of  mental  illnesses* 


i 


In  certain  cases,  a  deviation  in  the  work  of 


?  meclvinlsiQO  related  to  the  formation  of  nev/  eysteEiS  of 
i 

j  conditioned  reflexes  and  to  modification  of  the  work- 

! 

I  Ing  algorithms  of  thoBe  niarf  be  of  great  sig'-* 

( 

I  nificance  in  the  developsK^nt  of  pathological  states. 

I 

The  results  of  such  a  dlstur^bance  are  particularly 
Biarked  as  a  result  of  the  fact  that  a  slight  disturb- 

I  ance  of  these  systeiis  results  In  the  formation  of  an 

!  ■  ■  ■ 

\  entire  complev.  of  constantly  renewed  pathological  re- 

t  , 

i  flex  Eysteiiis — -which  Eiay  rciBult  In  serious  dlsturbanctes 

I  of  the  operation  of  the  regulatory  -mechanisms.  It  ap- 
!  ' 

I  pears  tlmt  this  type  of  dl.stm^banoe  oonies  into  play 

r* 

j  both  in  Study  of  the  problem  of  disorders  of  interiial 
organs  and  In  study  of  the  problems  of  lEental  Illnesses 


I 

«t 
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i/1'5/*  In  thlE  case  It  Is  probable  that  the  mschanlfiKB 
s’  '  ^ 

(which  proYide  for  the  deY-elopment  of  reflex  systems 
Irelated  to  the  protectlye  functions  of  the  organism  are 
Sof  greatest  importance*  Since  these  systems  are  among!; 


i  vns  mo 


St  active  their  deviations  In  the  direction  of 


■hypertrophy  are  most  frequently  observed, 

I  Knowledge  of  the  general  principles*  on  which  the 

I  control  systems  fonction  and  the  use  of  special  msthcfds 

(which  enable  us  to  invest5-gate  them  effectively  would. 

I  ai^pear  to  be  of  great  value  In  analysis  of  the  above; 

ic-aaes  of  the  development  of  pathological  processes*  This 

I 

(circle  of  problems  is.  in  the  province  of  cybernsttes*  In 
I  this  manner  cybernetics  may  have  a  certain  role  to  play 

I 

I  in  the-  study  of  pathogenesis,  as  noted  by  Acting  Member 
I  of  the  Aoadem;v  of  rfedical  Sciences  Y,  Davydovskiy  * 

The  possibility  of  simulating  certain  genei^'al  prln™ 
e5.ples  in  cybernetic  machines  m&j  have  great  value  In 
i  the  study  of  pathological .  phenoiriena, 

I  There  aivj  various  points  of  view  concerning  they 

!  problem  of  simulation  in  cybernetics*  One  of  them  was 


I  formulated  in  an  article  published  In  Pravda  on  29  May 

jl959  by  Academician  A,  Dorodnitsim  "The  possibilities 
i  ■  ■ 

I  of  modern  electronic  computers  are  so  great  that  they 

fwoxild  be  able  to  perform  practically  any  'intellectual* 


e^a)lii»9Sk 
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I'opepatlon  of  which  rmn  ie  capable  if  he  only  •undep-Btood 
I  "  ■ 

|th€^  logic  of  these  operatlonB, 

i 

f  Certain  InveEtlgatora  advanced  the  thesis  of  the 
I 

j impassibility  of  airmlating  conditioned  reflexes  on 
I  the  ground  that  it  1&  impossible  to  reproduce  In  models 
I  the  cc^rsplex  biochemical  and  biophysical  proseoges  which 

I  •  • 

I  play  an  important  part  in  the  operation  of  nerve  cells  a. 

However,  st5.ch  objections  are  based  on  ffilsconcexj- 
tlons.  A  model  never  completely  rep^-^oduces  all  prop¬ 
erties  of  the  object  being  simulated.  But  this  is  no>t 
f pufficlent  to  deprive  simulation  of  its  values 

In  speaking  of  the  slnsulatlon  of  the  conditioned  , 
reflex,  we  have  in  mind  not  full  reproduction  of  the 
entire  phenomenon  in  the  electrcnio  model,  but  only. 

f  the  reproduction  of  superficial  analogies  in  the^  work 
\ 

lot  the  miodel  and  the  object,  Siiperficially  the  model 
1  , 

f  and  the  object  are  deBcrlbed  by  similar  operating  al- 
1  c'-'^rithms  f Bee  Chapter  IV),  In  this  case  we  are  not 

f"  . 

]  iriteroBted  In  the  comple-x  of  bloc.hemlcal  and  biephysi- 

{ 

i eal  processes. 

In  passing  to  the  next  chapter  we  should  note  that 
such  psychological  and  physiological  terms  as  ‘'idea*", 
P'study'%  ’‘merfi.oi:7-”,  "the  development  of  a  conditioned  re-- 
I  flex/ etc,  are  frequently  used  in  ooiitem.pcraiv/  cyber- 


mnKMA;-  ■ 
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lnetl<i  literature  to  ehg.x'acter'lse  the  operation  of 

i 

r 

iKachines.  In  ejuploylng  this  already  CBtabliehed  temlii- 
I 

\ol^SI  ■^'2'  have  in  Miind  onli?-  the  coTnitainlty  of  oertsdn  5„sO“- 
? 

flats-d  principles  and  not  identi’fcy  of  the  in 

f  x,hs  bi'aln-.  and  'iri  tM  machine,  Itor  can  we  speaic  of  rediic- 
Jtion  of  ps^rphic  procepseB  to  the  pro oes sea  which  nnfold 
i  j.,n  machines. 


OHAFTg^  II 

I^ES  TiiBOKY  CF  AUTOMATONS 
(A  Short  SnrTey  of  Ke search) 


I  In  thi-B  Chapter  we  consider  the  wor:*!:  of 

I  certain  scientists  with  whom  the  deyelopy^ent  of  oyber~ 

I 

\  natict:  has  been  closely  assootated*  These  are  works  on 
I  the  general  theory  of  autoEmtons, 

I  a)  "rne  Nerve -.Net  work  Theory” 

I  A  mathod  ci'eated  In  recent  years  ty  a  group  of 

f 

« 

j  American  murophysiologl  stn  and  mstheiRaticians  (KacCulloch 
I  and  Pitts  /4l/>  S,  K,  iainl  /30/f  and  others.)^  which  has 


recently  'teen  defined  as  the  method  of  theoretical  neur¬ 
ology  or  “The  Nerve-Network  Theory”  is  of  great  interest 
for  stud:/  of  the  physiology  of  the  brain. 

In  19^3  the  American  scientists TJ,.  MacCulloch 

|V,  Pitts  arrived  at  the  conclusion  that  since  nervous. 

I 

I  activity  is  aubiect  to., an  ''all  or  nothing”  law>  neuron 


58 


events  and  the  rGlatlonishli®-!;© tween  them  may  be  studied, 
by  the  means  of  pnopbsltlonaX  logic*  On  the  basis  -  ■■ 
of  cer^t&ln  acBumptions,  they  created  an  abstract  model 
|o.f  t.he  neuron- ~ the  formal  neiU'on,  (For '  a  .mox’e  detailed 

I  • 

[discussion  cf  the  formal  neiU'on  nee  Chapter  VI )„ 

i  ■ 

Using  a  special  mathematloal  apnsrEtus  for  Inves-. 

i  - 

tigatlon  of  networks  constrnic-ted  of  such  neiunonSj*.  they 

!  /  - 

'detepml.ned  the  olaeses  of  events  v^hich  can  be  represented 

jin  such  networks*  However,  the  result  of  MacCulloch  and 

^  Fitts  5.B  rather  difficult  to  under st. and  and  this  prompted 
I 

|K.linl  and  later  Kedvedevato  (Question  once  again  whether 

I.' 

} it  is  possible  to  represent  events  in  nerve  networks  and  I 

i 

I  finite  autbm&tons, 

'  .  I 

In  conEldosrlng  this  problem,  mni  Introduces  the  I 

concept  of  the  regua.ar  event  j  "mj  event  is  re-ferred  to  f 

as  2»egplar  if  there  exists  a  regular  set  of  tables  ■  I 

which  describe  this  event  in  the  sense  tliat  the  event  j 
oeours  or  does  not  occur  depending  on  whether  or  not 
the  entry  is  deBcrlfeed  by  some  table  of  this  set/. 

It  wiis  found  that  we  present  this  class  of  regular 
events  and.  only  this  class  in  nerve  network  and  finite 
'  aia tome. tons , 

Fonriulatlrtg  this  conclusion  saxnewhat  differently,  | 
iKllni  shows  that  pr-lmitiye -recursive  events  are  p.rer-  I 
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i 


aenta’Dle*^. 

Let  us  ■conslde.t’  ais  an  exaiRple  an  event  wM'Oh  iB 
not  rspreBentatle  in  uuch  netwo-i^ke-  /30/« 

'The.wovk  of  Yu.  T.  Medvedev  AV  sets  out  to  ob- 


I  t&ln  a  x»esult  which  le  iiiore  easily  reviewed  than  ttia 


f  of  Klinl 


ife  introduces,  the  concept  of  the  finite  automatonu 


;  ^*An.  object  with  a  finite  number  1  of  states  a^j  j,  .a^j,  | 


*3Y  2'*^  “"ffi ! 

I  .  -  . 

i  and  a  finite  number  n,  >  1  of  Inputs  is '  referred  j 

1  to  as  &  flxiite  automaton  A*  Each  of  the  Inputs  'L  in  it-  j 

t  '‘-if 


self  determines  a  certain  reflection  Iv.a  of  the  set  b,  of  | 

'  ’f 


states.  Under  the  Influence  of  an  Inptrl;  I,  (k  «  Xf2.,>*njj,.  | 
I  the  automaton  A  passes  from  a  state  (i  jk--  to 

a  state  ss' 

All  finite  autom^itons,  including  the  nerve  networks 
of  .MacCulloch  and  Pittru>  come'  under  this  deflnlt5.on. 

I’hey  go  on  to  discuss  certain  events  which  traty 
call  “elementax’y’^  and  bs.sia  opsimtions  performed  on 
events, 

us  expla.ln  what  is  meant  here  by  the  word 
'‘event. Factors  which  are  external  to  the  automsiton 
and  give  rise  to  disturbances  of  one  or  another  inj 
j  are  called  syiTihols.  "Any  aomblnatlon  €  of  ssuEbol  ap 


1  uearaneeH  may  be  referred  to  as  an  event  E  about  th® 

f 


1  ’*’'See  reference  '31  for  prlmitlve-recxirslve  events. 
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jE-cyfflbolB  ip  gg,  In  other  wordSj.  everyr  event  ie  | 

|3,efined  by  the  resolution  of  a  certain  set  of  ftrlte  f 

jCn-^dered  igjrrfifcol  sequences’*  /44/.-  . 

i  I 

?  Ab  an  ex.aiAple  of  an  elementery  event,  let  ue  con-  | 

I  .  ■  I 

rfjlder  the  event  E-'-^an  event  which  occurs  when,  and  only  \ 

I  '  I 

Iwhen^  there  appear  symbols  with  which  the  symbol  Si  \ 

i  ■  ^  I 

I  appears  at  the  present  momerit^  I 

f  '  I 

I  Six  basic  operations  are  perforraed  on  svsjitB,  The  I 

I  I 

I  conjunction  *  Eg  may  .eeiv’-e  aa  an  example  of  a  baaie  I 

(operation,  i,e,j  the  ev'ent  occurs  'when  "both  of  the  events  t 


Ej  and  Eg  occitr^ 

The  outcomfi’  of  Medvedeva's  work  is  the  thecreiar 

’’Those  events  which  can  be  obtained  from,  elementary 
events  bj/  way  of  a  finite  number  of  applications  of  the 
basic  operations,  and  only  those  events,  are  representa'- 
ble’\ 

Thus  the  events  which  can  be  represented  in'  a'  finite 
automaton  constitute  a  limited  class  of  events..  It  does 


I  not  follow  from  this,  however,  that  non-'repraBevntable  i 
I  .! 

i  events  have  any  sort  of  biological  Bignlfic.ance,  ! 

I  ! 

I  The  neuron  model  constructed  by  MacCulloch  and  | 

0  ^ 

Pitts  is  not  unique,  in  a  report  bofore.  the  International  I 

I  1 

I  Conference  on  Information  Processing  held  in  Paris  in  | 

1 1959#  D,  VJllllB  /22./  suggested  a  plastic-neuron  model,  | 
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* l«e^?  a 


neijron  I'^’Mch  ohangee  its  logical  proprieties  in 


I  accordance  with  its  activity,  ¥illis  asserts  that  this 


fora  of  the  nlastlo-neiiron  raodel  is  corepatihle  with  the 


\ 

\  large  capao5.'ty  and  the  clearly  defined  arTbitrasay  sexec- 
[  tion  characteriaticB  of  the  human  rosMjry, 

i  ■ 

(  The  fori?i.al  model  of  the  ntei'ron  differs  in  many 

I  respects  fi?om  the  real  neuron,  Thus^  the  real  neuron 

j 

I  can  transmit  the  intensity  of  fitimnlation  by  sending 
j  repeated  impulses  with  variable  frequency, 

^  However,  the  analysis  of  nerve  networks  consisting 

o'f  neurone^  closely  Bimilai''  to  real  neurons  i a  highly 
I  complicated  mathematically^  since  time  parameters  and 
I  the  tlme^variable  e*JCcltatlon  threshold  of  the  neuron 

f 

I  appear  in  the  description, 

I  ko.  interesting  question  is  considered  in  the  work 

j  of  K,  de  liteu,  E,  F.  Moore,  C,  E.  Shannon,  and  N,  Sha,- 

I 

j  piro  entitled  '■CoHiputability  on  Probability  Machines” , 

I  la  there  anything  that  can  h#  done  by  a  maohine  with 

I 

1  random  elements-,  but  cannot  T:>e  done  by  a  da  termini®  tic 

1  ,  •  . 

I  imachinsi  It  develops  that  a  certain  class  of  probabil™ 

I  Ity  machines  posseasee  somewhat  higher  capabilities 


than  the  deterministic  machines* 

In  Itself,  the  method  used  by  MacCuIloch  and 


Pitts  and  by  others  cannot,  of  course,  solve  the  p2'*ob“ 
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enaoimtex'ed  in  utndy  of  the'  bralru  PoEltive  results  | 

5 

can  be  acbd.eYed  only  by  combixied  use  of  various  lastliods  | 

I 

of  Investigation}  here  tlie  physiological  n'lethod  of  in-  J 

f; 

ve 8 ti. gating  higher  nervous  activity's  as  ^vorloed  cat  by  | 

i 

I'»  ¥^,  Pavlov^  will  be  of  rnajor  significance.  The  nerve;-  J 

t  , 

ne-bworlc  tlieoiyr,  ho'^'^ver^  is  a  val’iable  coRiplenent#  which  I 

e 

broaden®  the  prospects  for  investigation  considerably,  | 

I 

b)  Synthesis  of  Automatons  | 

i 

Niinierous  investigators  a'^e  Interested  in  probleB;.s  j 

■i 

of  the  synthesis  of  autotmtons ,  Certain  basic  properties  j 

I 

of  the  brain  are  taken  into  eons iderat Ion  in  this  Byn-  ? 

1 

thesis,  .  ■  i 


In  particular^  J,  T,  Calbertson  in  his  work^ 


I 


•Cei-' 


I  tain  Non-hconomio  Ra searches”  /29/  considers  the  qiies-” 

I  tion  of  the  pi-inciplss  of  a  robot  which  might  be  con- 

Istructad  to  possess  capacities  for  ccniplex  forms  of 
behavior  without  limiting  his  spec'alation  in  any  vtay 
t  whatsoever  in  I’egard  to  tiie  mntber  of  ‘working  elemehts 
I  used  or  the  diirenplons  of  the  Siachlne* 

I  He  considers  two  types  of  robot— a  robot  without 

P 

I  memory  and  a  complete  robot, 

I 

I  .  The  robot  -without  memovy  iB  constr*acted  aa  followBs 
6 

I  He  'Se-lectB  a  certain  nuriber.  of  receptors  and  a  certain 
mmber  of  effectors  and  cemposes  a  program,  A  certain 


j 

I 

! 

i 


i 

f 

i 

ft 


I 


I 


f  cH>ri:,l>l;natlCfn  of  e.f.fectOi*s  Is  up  In  coppe' SocKndiance  I 

i  ■  •  ■  '  ■  '  ( 

f  in  tiie  program,  of  each  cosibi.iiatton  of  receptors  (See  f 

} 

I  Cha/pter  VI  )4.  O.-hen  the  robot  is  assembled  according  to 

L. .  '  = 

I  tnls  pr>ograa?u 

i  .  ■  ■ 

I  Tl'ie  cosiplate  robot  differE  fi'om  the  robot  wltliout  ; 

;  jaomory  In  that  It  has  raemory  cells  and  the  robot  ’^re- 
;  member.^"  eve;j:ythl!ig  t;hat  has  happened  to  it.,  Tlie  pro-  5 

I  ■  ■  ■  -  i 

f  gram  for  the  eomolete  robot  is  approximately  the  same  j 

!  .  '  I 

I  at  for  the  robot  without  meraoiyj  only  eacsh  ccmbl, nation  | 

■  i' 

I  '  ■  1 

i  of  ef',feotor.s  ts  set  u-d  tc  correEpond.  to  a  def^lriite  set 
I  ,1  f 

I  of  memory  cells*  | 

i  ■  t 

\  Ctilbertson  oomes  to  the  conclusion  that  t:he  coiR’-  I 

I  '  I 

I  plate  robot  can  in  principle  carrr/  out  a,.ny  specified:  ' 

j  program^  ''’clerei'lry  solye  problem, compose  symphontes  ’  $ 

!  etc,  [ 

\  i 

,[  it  possible  tc.  construct  a 'complete  robot  | 

th£it  behares  Itself  in  the  ssmis  way  as  John  | 

I 

In  this  traet  It  does,  not  seem,  so  to  uu., -Can  such  [ 

f 

■a  .robot  corr^ose  a  symphony  on  perform  any  creative  W0:rk  i 

i  '1 

j  at  allt 

I 

\  It  i»  hardly  likely  timt  It  could  do  thisi  its; 

I  creator  would  have  to  do  all  this  for  it  in  advanee  i;n 
I 

I  composing  the  program, 

i 

I  Since  the  connections  between  the  effectors  - 


{ 

\ 
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1. 


> r iwiiumi  nifiwir '  llHIf*”'' ”****^  -P 

s.n^  the  mei'ory  <5ellsi3  ai»g-  ■f^.ly  detenaln&d  hy  the  p2?©“>  [ 

gi*ar;i^«  Ita  ’^Memory’*  can  do  no'tMng  foi*  this  robot.  It  [ 

I 

1&  unable  to  aoeumulate  experience  and.  behaYO  In  aceord--  I 

? 

ano#  with  Its  accurnuD.Eted  experience ,  Such  a  robot  can 

be  created  only  for . a  definite  state  of  the  envlroOTent  | 

,  ■  ■  .  ■■  .  ■  ■  t 

I  and  ?Jill  expli'»e  If  the  envlronaient  changes ,  .?ii:r"thers«fflr'e#  ; 

i  «  ’  i 

I  its  potentialities  are  no,  different  frosi  those'  of  the  .  f 

I  I’o'bot  ^fithout  iBcmory,  Indeed^  suppoEt  we  set  up  every'  I 

f  ■  I 

I  set  of  itemoi**/  cells  i-n  oorrespondenoe  with  a  definite  | 

I  set  of  recap  tor  nam^ns,  I-et  ufi  le.aYe  the?  program  and  I 

I  ,  ,  '  •  i 

I  the  effector  neurons  just  as  tbiey  are  in  the- complete  I 

'  .robot.  In  this  manner,  )^e  ghal.l  obtain  the  robot  .with-  | 

out  memory  with  only  the  mm'ber  of  receptors  deci'osEed,  | 

It  is  clear  from,  this  that  the  construction  of  | 


robots  of  the  type  described  by  Calbertson  ii!a.h:eE(  no  | 

sense.  It  is  necessary  that  tlie  robot  be  able  to  accit-  I 

I 

iiiulate  inforiratioii  from  the  extei^nal  medium  and  to  | 

act  on  the  basis  of  Its  acci.nitu.lated.  experience.  To  ac~  | 

complish  this  the  ccnnectiona  b@tv<feen  the  -effectors  I 

and  the  iRcmory  cell.s  must  not  b©  predetena5.ned.j  they 
ift’ist  be  established  as  a  result  of  intersvCtlon  with 
the  environaient ,  The  condltional'-probability  machine 
of  Attlee,  tl^  ”Fercaptron”  of  Rosenblatt^,  and  tl^  I 

automaton  described  at  the  end  of  this  book  may  be  in-  I 
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i 


eluded  tmong.  Bueh  aiitoniatons^ 

IDbeBe  t.h2*-ee  wo:.:*^:^  are  aimllai*  as  regal'd®  their  final 
purpose s>.  but-  the  vrmiten  taken  are  different  in  sll 
three  cases-,  .  ' 

Attlee  *K  rrsacMne  /Y#8/  if.  based  on  two  familiar 

mEthematical  relationships i  The  .first  is  the  incinslon 

relationship  of  mt  theorjr  and  the  second,  is  the?  con-' 

dltioiml"" probability  relationship.  The  nmohlne  clas-Si"- 

fie®  external  disturbances  on  the  basi-s  of  the  first 

relationship  and  cartai.n  concepts  are  foriaed  in  the 

liiachine.  Certain  concepts  may  o-ccur  in  conjunction  with  . 

a  certain  degree  of  probability,,  i.e,,#  there  exists  a  j 

certain  conditional  probabil.ity  between  the  appe8,rancee  .  | 

c?f  ttese  concepts,  Establlslonent  of  the  value  of  this  | 

oonditlonaJ.  probability  ree-sultb  In  a  eonchltioned.  r€.flex  | 

1 

l.f  the  jr.acMne  Is  equipjjed  with  effector  aechanis-ms  ! 

If  in  addition  to  the  direct  path.B  betweern  the  in- 
ptj;t  fd.gnals  and  the  conditional  probability  machine 
there  are  paths  with  delays,  then  the  machine  will  be- 
able  to  diBtlngulBh  tlnie  repre-Henta.tlonB, 

An  article  published  in  the  magazine  ''Aviation  Week 

S 

/l8/  co.ncerni,ng.  the  creation  o.f  the  "Perceptron”  electroril|j 
computer  by  the  American  Ozone  Block  is  also  of  interest,  | 
It  is  stated  in  the  report  that  this  rtia  chine  Is  capable  of  I 


t 
f 

t!  \ 
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icl3,3Slf>'lngjf.  aenslng  and  z*epre aentliig  symbolically  Its  ex-  | 
jtennai  environment  and  also  of  taking  Into  account  com-  | 

jpletaly  new  and  'anforesean  changes  In  Its  environmental  con^ 

f  f 

iditlon. 


Although  it  Is  difficult  on  the  basis  of  the  short  f 
^report  to  appreciate  the  principles  on  which  this  machine  IS 


Scons  true  teds  certain  details  of  its  operation  arer  similar  to  f 


Sthe  classification  machine  of  Attlee «  Specifically,,  the  as-! 
;  t 

f  i> 

i  i 

iscclating  cells  of  the  ’'PerceptJ^on’’  (memoi’^  cells)  -are  con-| 

i  ■  '  .t 

inected  randomly.  i,e.>,  it  can  be  stated  with  a  certain  j 

^  .  i 

^probability  that  a  given  cell  is  connected  to  another*  The  i 

! '  '  '  I 

|Ba?rie  state  of  affairs  is  observed  in  Attlee's  machine*  Lik:e| 

Attlcfe’s  Jiiaehiim’j  the  ’’Perceptron"  is  capable  of  leaiviing,  | 

An  autoinaton  that  is  also  capable  of  learning  and  I 

! 

identifying  time  representationo  Is  deEcx^lbed  in  the  last  I 

I 

chapter  of  this  book*  The  p;rinclples  on  which  it  is  bfxsed  { 


‘(differ  somevJhat  from,  the  ■  princlp)les  of  Attlee's  and  Rosen--  I 

^  ■  i 

''blatt's  maehlneB* 
i 


he- 


I  An  interesting  report  from  Ashby  /6l/  considers  t 

\  i 

^problem  of  creating  a  thought-Cc^,paclt3”  amplifier*  Ashby  ln“| 

f  { 

Idlcates  that  thought  capacities  can  be  reduced  to  t.he  suit-l 

i  ! 

jable  selection  of  the  required,  variant  from,  among  a  set  of  | 

I  ■  i 

Ivarlants,  It  develops  that  a  machine  v.rhich  is  capable  of  I 

3  '  ■  I 

iselectlon  can  be  created,  but  the  time  of  selection  la  I 
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fextremely  long*  Ashby  Indicates  methods  of  I’^sdnclng  the  tlm«|' 

f  < 

|.’'eqyired  for  trial,  .  ; 

Idift  though t'« capacity  a'nQrllfier  is  based  on  the  homev' 

iiBtat,  I 

f  ■  •  ■  ( 

1  The  problem  of  concept  formation  in  automatons  has  \ 

lattracted  great  interest.  A -rfeport  by  Mackay  entitled  "The 

iToblem  of  Concept  Formation  by  Automatons"  /k2/  is  devoted| 

!  f 

jto  this  problem^  .  | 

I  ■  Mackay  indicates  two  directions  in  which  the  solu-  i 

tlon  may  he  sought.  He  considers  it  possible  to  construct  ! 

|sn  automaton  that  forms  abstract  concepts.  Such'  an  automatoj. 

jmust  continuously  work  out  tentative  organizing  programs,  | 

which  are  coifipared  with  signals  from  the  envlronme-nt.  For  ■ 

an  abstract  concept  to  ba  formed  it  is  necessary  to  have  a  j 

hierarchy  of  such  systems  with  each  system  forming  a  con-  n 

icept  of  a  hxKhex-'  order  of  abstraction.  . 

i  " 

The  report  entitled  "Experiments  on  a  Ifechine  that  | 
Thinks  and  Learns"  by  the  English  scientists  '1\  Kllburn,  \ 

R,.2.  Grimsdale-  and  P.H.  S'umnei^  who  carried  out  their  ex-  j 


perlments  on  a  general-purpose  digital  computer  Is, of  in™  | 

s 

{ 

terest  In  this  sense, ‘A  criterion  for'  evaluating  the  use-  j 
fulnesB  of  the  programs  was  introduced  and  the  machine  j 

■  ■  i. 

selected  useful  programs,  | 

Although  at  the  present  time  all  programming  work  | 


J 
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ks  done  by  liumanE^  it  Is  possible  that  we  shall  succeed,  iji  ? 
losing  machines  for  the  corr^oBiticn  of  programs  as  well*  { 


llhe  reports  of.  E*F„  Moore 


consider  methods  of 


llnvestlgation  by  means  of  which  the  experimertei^j,  without  | 
ponowing  tlie  internal  structure  of  the  a'atomaton,.  can  form  \ 


fconcepts  concerning  the  pi'dnclples  of  Its  operation.,  draw  s 

1  '  ' 

[concluElons  as  to  the  identity  or  nohidentlty  of  different  | 
lautomatons  and  their  internal  state  at  a  given  Baoraent  of  I 

i  ■  .  \ 

ftlm.e.  These  methods  of  inuegtlgatlo.n  are  based  on  a  rigor-  ? 

^ 

louslr  formalized  system  of  operations  which  the  experimenter  | 

!  '  '  -  *  I 

Iperforms  on.  the  automaton  in  the  course  of  the  experiment  -i 

I  ■  ^  '  '  I 

land  on  special  methods  of  analyzing  the  syste.ms  of  response^; 

i  ■  ,  •  I 

Hi'lth  which  the  automaton  r’esponds  to  these  operations*  The  } 

f  .  .  '  .? 

I  If 

^discussion  preoented  is  of  interest  for  study  of  t.he  opiera-j 

I  ■  I 

iitlon  of  the  brain,  which  ie  also  baaed  on  the  performance  of 

I  ^  I 

leerleB  of  specially  designed  operations.  :■ 

I  ^ 

^  J.  Neumann’s  system  of  ideas  on  ways  to  synthealzej 

I  ,  '  i 

ireliable  autoBiatons  fi’om  unreliable  "components”  (elettentB )‘ 

i 

1/51/  Is  also  of  great  interest.  An  eseentlal  difference  | 

'I  •  'I 

lhas  been  detected  on  comparison  of  the  brain's  operatlo.n  i 

>■  s 

S  ■  ' 

iwifch  the  operation  of  cybernetic  machiruesj  this  consists  Jnj 
|the  fact  tliat  in  the  machines^  the  failure  of  a  single  ele-  ! 
Lent  (for  exajBpl^  a  radio  tube)  results  in  disturbance  of  | 


|the  operation,  of  the  entire  system, 
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!  "  In  the  nervoTiB  syateroj.  however'#  the  removal  or  des-  f 

I  .  I 

|trnctlcn  of  even  a  large  iruKher  of  nerve  cells  does  not  -uBuf 

I  '  '  { 

lallj  result  in  a.n  irreversible  distiirbance  in  the  work  of  ; 
f  '' 

fthe  breln.  On  the  basis  of  these  facts#  J.,  Ilewmmn . /t>l/  ar*  f 

drived  at  the  conclusion  that  there  exists  in  the  brain  a. 

r 

i 

^special  system  of  nerve  “-network  organisation  which  possesGo  : 

I  the  singular  important  property  of  stability  to  disturbancei 

i  ■  ■  i 

I  by  virtue  of  which  the  cutting  out  of  a  single  eleroant  doesj 

jnot  result  in  a  distiarbance  of  the  over-all  system’s  opera--| 

Itioru  Each  nerve  cell  is  an  "uvireliable”  eletnenu?  l,e*#  an  f 
I  I 

I  element  which  cea.Be  to  fu'«:jtion.  13ut  the  nei’vo  network  | 

I  as  a,  whole  operates  as  a  completely  "reliable”  system,  I 


J,  Neumann  attempted  to'  explain  the 


atlonal 


(and  operational  principles  of  the  systems ■  whivCh  could  form  J 
f  ■  .  ,  ‘ 

[the  basis  of  this  effect,  and  to  develop  a  theory  to  enablel 

■  { 

juB  to  build  fully  reliable  laachtnes  from  U2ir*ellable  elemen'^^-' 

(S's-ch  riischlnes  would  not  stop  working  ■when  individual  ele-  ? 

! .  I 

[menta  are  switched  off.  On  the  basis  of  the  investigation  \ 

i  * 

I  which  h,e  conducted,  he  created  a  system  .of  concepts  which  i 

I  ^ 

1 consider 3  the  theory  of  this  problem.  He  worked  out  a 


.schematic  diagram  of  a  machine  which,  although  it  was  com-  s 

posed  of  "unreliable"  elements, ■ -tifould  work  as  a  fully  re-  | 

I  ■  •  ' 

lliable  system,  i„e,,  v?ould  possess  propertleB  characterls-  | 

ftic  of  the  brain,  •  ■  | 
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■'A 


Such  are  the  hasle  .directions  of  work  in.  cybernetics  | 
lat  ti-xe  present  tlae.  Other’ research  is  devoted  .to  the  syn¬ 
thesis  of  autoiRS,tons  that  simulate  the  functions  of  the 


brain* 


I 


However,  the  physiological  methods  alone  are  like- 


Ivlm  incapable  of  solving  these  problems*  f 

f'  ■  '  ■  ‘  •  I 

I  Therefore  .scienti.sts  in  the  various  specialties-.-  | 

jrrtathematicians  and  physiolcgiatc,  neurophysiologists  and  j 

I  •  ■  ■  f 

englri©er.s — must  work  together  in  order  to  arrive  a.t  a  sue™  I 

I  ■  ■  I 

Icesaful  solution  of  the  problems  that  arise  in  study  of  thej 

I 

brain*  | 

GimiTE?  Ill  I 

COmOL  SYSTEMS  OPElATINa  | 

FR.CM  FIXED  FROGHAMS  | 

.1- 

Let  U3  begin  our  exposition  and’' analysis  of  the  | 

,  ■  i 

operating  principlss  of  systems  v?hioh  are  capable  of  highly| 
complex  types  of  p-arposive  behavior  on  the  baais  of  a  pro- 
vlouEly  specified  program*  Such  systems  ar^e  not  c.apable  of  [ 

I 

independent  development  of  new  forms  o.f  behavior  (of  the  | 
learning  pro  cose),  -I 

To  a  certain  degree,  the  behavior  of  the  spider  | 

which  constructs  a  complex  configixc'atlon  of  f5.1a.msntB  in  | 

i  ■  '  I 

I  the  form  of  a  cobweb  and  the  complex  behavior  of  ants  or  | 


5 

L 
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icees  might  h&  tafem  aa  exariples  of  the  operation  of  syBteins  j 
|cjf  this  t;7pe«  The  hehavior  of  the  dyng beetle  which  cor-  j 
ptr^iotB  a  special  cocoon  in  which  its  larvae  will  develop  ^ 
|n3.ght  also  be  noted  as  an  example*  ThiB  behavior  recognisesi 
ks  It  were,  the  needs  which  will  be  felt  in  the  fwt'ffi'e  aiteh 

f  ■  jC»  ^ 

fthe  birth  of  the  new  i rid ivldnals  and  provides  conditions  loj: 

?  '  '  t- 

[the  satisfaction  of  these  needs*  f 

I  The  deveicxiirent'  of  conditioned  ref-lexeB  rs  also.  pos|' 

I 

:Bible  in  insects,  . 

j>'  *  I 

'l'*h&  ir!ach'<ne3  which  control  the  opsi^atlon  of  incins-  | 

i 

trla'!  undertakingB  and.  provide  for  the- ■mainifacti3i’'e  of  pro-  f 

! .  I 

iductg  also  show  complex  forms  of  tjehavlcr.  I 

i.' 

•  *  } 

In  t'iiO  former  esse.*  the  B€Q.o.ence  of  opers.tions  car-| 
rlod  out  by  the  IncactB  (the5-r  work  program)  is  determined  | 
by  hereditary  forms  of  organisation,  of  its  nervous  systerri  | 
wV-jAh  were  developed  in  the  process  of  evoliition.*  In  the  [ 
operation  of  the  machine^  the  work  program  is  provided  by  j 
the  a'utomatlc-eq'ulpment  designer*  'Hie  behavior  of  the  sys-  1 
fcer/i  ynaj  be  hlghlz/  complex  in  either  case.  For  example,  the  j 
construction  of  a  cobweb  or  atn  ant  hill  ffi.ust  proviae  the  | 
ooBBlblllt3^  of  sequential  transition’ frem  the  performance  j 

of  one  operation  related  bo  one  form  of  activity  to  arioth0r| 

liie  ssrstem  can  pa.S!S  to  a  later  stage  of  the  work  01117/  alterl 

I 

corapletlon  of.  the  preceding  phase,  .  | 


I  Tho  nature  of  the  InsectB*  motions  must  he  deter- 

f  '  ■  - 

iiiined  In  a  complex  manner  by  the  results  of  the  previous 


activities  and  the  stage  to  which  the  work  (for  examplej  the: 
constr'action  of  the  ant  hill)  has  been  carried,  The  behavior 
jof  the  insects  depends  In  each  of  its  stages' on  a  whole  in-j 
:trlcate  complex  of  stimuli  arising  from  the  environment.  \ 

4 

It  is  important  to  note  that  in  carrying  out  com¬ 
plex  forms  of  behavior,  it  is  found  possible  to  vary  the 


program  of  activity  of  the  animal  in  accordance  with  the 


results  of  its  •orevlous  activities  and  to  svifitch  from  one  | 

i 

program  of  activity  to  another.  I 

In  this  connectiohj the  experiments  conducted  by  thef 
famous  Polish  scientist  Ya.K.  Dembovskiy  /27/  are  of  great  j 
Interest.  It  was  shown,  for  example,  that  the-  x’-emoval  of  a 
diving  beetle ’'s  svi'imming  legs  results  in'medlately  in  a 
shift  to  another  system  of  activities  which  permits  the  in¬ 
sect  to  move  by  another  method. 

The  possibility  of  BV?ltchlng  behavior  from  one  pro¬ 
gram  to  another  accounts  for  the  surprising  results 
achieved  by  insects,  e.g.,  in  the  construction  of  an  ant 
hill  or  co'bwe/b  under  conditions  in  which  temperature,  .  viind 
direction,  humidity,-  the  quality  of  the  structural  materlall 
(in  the  case  of  ant  hill  construction)  and  other  factors 
iare  continually  changing.  Yet  in  each  case  the  shape  of  thel 
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^obvKs'b  is  found  to  be  precisely  adapted  to  the  contciirs  of  j 
ji-ts  location^  and  in  cases,  where  the  Intepjrity  of  the  cob-  ■■ 

.|(i?eb  o.r  ant  hill  has  been  disturbed,  the  activities  carried 

!  ■  '  /  I 

,  but  by  the  insects  are  in  strict  correspondence  to  the  na~  i 

I  * 

'ture  of  the  damage  that  has  occurred,  •  ? 

i  '  •  ■  . 

I  The  comples:  forms  of,  behavior  deaeribed  here-  are 

i  ■  ■  ■  ’ 

ibasieally  instinctive  In  nature.  Although  variants  which 

I  •  • 

[permit  transition  under  certain  conditions  .from  one  program- 

f  1 

|to  another  Riay  be  provided  in  the  actual  structure  of  the  t 

Ibehavioru  all  of  these  variants  are  rigorously  predetermine -1 
5  •  ’  ■  .  ; 

land  thelir  number  is  limited,  -  j 

f  i 

I  ,  The  introdxictlon  Into  the  operation  of  the  system  I 

i  '  ■  '  ' 

during  the  ccuirse  of  the  experiment  of  any  dlsturba-nces  I 

I 

which  could  not  take,  place  under  the  natural  living  condl-  | 

} 

tlons  of  the  animal  and  consequently  could  not  be  provided  j 

for  In  the  process  of  evolutionary  development  by  means  of 

/ 

an  appropriate  program  results  in  destruction  of  the  entire* 

[ 

cycle  of  behavior.  This  is  attested  to  by  the  numerous  and  I 

'  I  '  '  -  1 

well-knovjn  experiments  5,n  which  bees  have  •continued  to  seal! 
honeycomb  cells  even  though  the  honey  has  been  removed  froBij 


them, 


The  work  of  the  endocrine  glands  is  also  of  great 


ilmportance  in  the  execution  of  complex  forms  of  behavior.  \ 

I  ' 

Irt;  has  been  demonstrated  for  example  that  the  cor?).plex  forrasi 

'■  I 
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\ 


pf  behavior-  related  to  reproduation  are  closely  aESociated  ■  | 
^?lth  the  presence  of  the  sex*- gland  hormone  in  the  blood,  ? 

It  should  he  noted  that  the  design  of  machines  r^hich 
fciontrol  the-  operation  of  industrial  under  makings  also  usually 
[pro vide g  the  posnitlllty  of  changing  the  programB  and  | 

bwltchlrig  the  operation  of  tiie  system  from  one  pi'Ogjr'ain  go  ^ 
janother  In  accordance  wi.th  the  results  of  the  preceding  ac"'? 
tivity  and  the  sum  of  the  external  influenijes*  j 

f 

,1 

a)  The  Reflex  Principle  In  the  Operation  ef  Control  Systems^ 

A  characteristic  property  of  systems  of  this  type  ■  ;| 

I 

consists  in  the  fact  that  they  >fork  on  a  general  principle  | 
which  might  be  referred  to  as  the  principle  of  the  "reflex  I 


I  reaction". 

1.  .  essence  of  this  principle  consists  In  the  fact  | 

I  ■  I 

ithat  the  tehavior  of  the  system  is  a  series  of  responses  to; 

I  ■  '  .  I 

|definite  signals  received  from  the  environment.  The  generalj 
bheme  of  operation  of  a,  system  of  this  t3T:>e  my  be  charae-  I 

■  ■  J 

fte-^’ls'ed  as  follows.  A  certain  signal  acts  on  the  system  anoi 

I  ■  I 

lin  response  to  this  signal  the  system  passes  to  a  state  | 

fand  perfoms  the  activity  c^.  As  a  result  of  this  action/  j 

^certain  cMnges  appear  in  the  environment.  Information  con-”[ 

|cerning  tiiess  changes  entei’S  the?  system  in  the  form  of  a  | 
i  ■  i 

isignai  Kg,  Tha  signal  Kg  causes  a  change  in  the  state  of  | 
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^the  B:/sl;eTR  from  K^  to  >Cg  sjvS  th^  appearance  of  a  new  motion  j 

k„  which  in  tixrn  gives  rise  to  the  appearance  of  the  ±n».  J 
!  '2  , 

iforsation  and  so  forth,,  '  ^ 

}  Behavior  of  this  type  on  the  part  of  tiie  eontrol  .  f 

Lysto®  is  determined  hy  the  fact  that  its  operation  proeeeo. 
lin  close  interaction  with  the  external  medium  surrounding  ^ 
n-\-ptem,ov  fusing  t^ie  terminology  of  Maokay  /^2/%  ‘fne  ? 
jadanfclve  field  of  activity  of  the  system'*.  Here' the  he-- 
jhavior  of  the  systeraj which  is  directed  toward  a  change  in 
Ithe  external  medium  in  the  appropriate  direction.  iKUSt  he'  | 
jeontlnuously  corrected  hy  the  input  and  procss^lng  of  :  | 

I  formation  reflecting  the  result®  of  the  systemis  operation  j 
lin  the  various  stages.  In  this  manner  a  complex  process  of  | 
j  interaction  between  two  systems  -  the  hr-ain  and  the  extern4l 
medium  -  takes  place  in  the  course  of  complex  behavior. 

I  In  the  case  of  the  raachiWB  operation,  a  complex  ^ 

Lystem  of  interaction  comes  into  play  between  the  control .  j 
system  and.  the  controlled  object.  Ihis  problem  is  analyzed  | 
in  detail  in  the  speciailEed  work  of  I.l«  Q-al  ^pecj-ii  /<^b/*  ’ 

The  problem  of  the  principles  of  operation  of  automatons  is 
[also  Illuminated  in  the  works  of  S,K.  Kl-lni-  /30/.  | 

Icalbertdon  /29A  B.K.  Mackay  /k2/  and  other  authors,  j 

I  The  principle  of  the.  reflex  re8,ction  was  first  In-  | 

ftroduced  to  science  by’DaEcartes  to  account  for  the  beha-  | 

I  I  T-  -_.f  -  i-r  I  .■■■■-nil-— -T _ 


vlor  of  animls.  Here  Desoartets  mads  use  of  the  analoo'  fee- f 

•  •  ’  ■  .  ] 
tween  the  opei»ation  of  living  organisms  and  the  principles  j 

of  ti'ie  water  clook,  waterworks  and  other  raechaiiical  devices  • 

v/hich  came  into  being  during  the  17th  century  ,  | 

Scientific  study  of  the  comple:^.  forms  of  behavior  | 

jof  an?,mala  became  possible  on  the  basis  of  the  mathamitlcal  * 

I  ■  ■  >*  ? 

Iteacshings  of  Sechenov  ■/56/  and  I„P,  Pavlov  /54/,  j 

'  ■  .  1 
I  According  to  the  basic  points  of  this  doctrine,  the  | 

a€t5.vity  of  the  brain  is  eojMpletely  determjjied  by  conditions 

In  the.  envlTCnmo.nt,  Ttm  work  of  the  brain  Is  a  system  of  j 

I 

reflex  responses  to  extremely  ccmple.x  sets  of  Btlmull  ar*-  | 

riving  from  the  external  medium.  Kero  a  distinction  Is  i' 

* 

jdrawn  between  several  typos  of  reflex  activity? 

I  a)  the  condltioned-reflex  activity  which  forms  In 

I 

mn  and  animal  during  their  lives  and  vrhich  is  based  on  the 

I development  of  systems  of  conditioned  reflexes  (the  learn- 
I 

ling  process)  and 

5  ■  b)  uncondltloned-raflex  activity  which  arises  in 

i 

^th&  animal  at  the  moment  of  its  births 

I  The  instinctive  conditioned-reflex  f'cnsi  of  behavior 

jis  a  property  of  man  a^nd  animals’  at  different  evolutionary 

Ilevels,  In  the  lower  animal,  ho-wev^er  (and.  in  insects  In  pa.r- 

tlcuXar),  these  forms  of  ner*>,'ou3--Bysteni  activity  teve  been  I 

extensively  developed  and  are  assent 5.ally  what  deteriiii,nes  | 
the  behavior  of  the  animal b,  ■  . I 

--  - - --  ..  — I  -iwrtjm  irfr-  i-if  -  trT 
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Regulation  of  the  activity  of  the  Internal  organs  ie 
il&o  accompllBhed  on  the  principle-  of  complex,  sys'sems  of 


Imcondltionod  reflexes*  When  certain  stimuli  act  on  the  or-., 

I  .  -  .  .,j 

i^anisraj,  'we  obEerve  a  highly  complex  pattern  of.  redlBtrlbutxC; 

i  ■  ^ 

jin  the  xinfolding  of  the  various  processes  in  the  organism,  j 
Wlien  a  painful  stimulus  Is  applied,  for  example^  the  blood,-,  J 
pressure  lovely,  the  coagulability  of  tlie  blooa.j,  and  its  j 
:saig;ar  content  all  increase,,  the  activity  of  the  digestive  j 

gland  is  Inhibited.,-  and  so  forth,  .? 

\  Ihe  operation:  of  mechanisms  which  maintain  constanc'|- 

1 

ixi  certain  functions  which  arc  of  v^ltal  importancci  for  the  | 

I 

organism  tuider  chsinglng  conditions  (constancy  of  the  con-  | 

centratlon  of  sugar  in  the  blood.,  constancy  of  the  blood  *  I 

pressm’^e  level,  etc*)  -is  of  great  lmpoi“tance,  ’  | 

In  stir-dy  of  these  complex  processes^  researcnere 

'encounter  situations  In  which  a  certain  reaction  of  the  or™ 
f 

panism  depends  on  a.n  entire  ensemble  of  interoreceptlv©  £ind| 

'  i 

exteroceptive  .signals  and  constitutes  an  integrated  re-  | 

sponse.to  this  complex  of  stimuli,  | 

k  whole  series  of  presBing  problems  arises  In  Btudyf 
of  the  laws  on  which  the  functioning'  of  systems  of  this  | 

f 

type  is  based  In  the  plan  of  theoretical  cybernetics,  ¥e  I 
encounter  the  problem  of  study  of  mechanisms  which  are  ^ 
capable  of  pjoovldlng  for  complex  forma  of  behavior  of  the  j 
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.aysbeBi.  The  problem  of  the  principles  which  make  it  poB0lble| 

I 

:o  switch  the  syotem  from  one  progi'am  to  another  is  of  great 

^Importance;  the  same  applies  to  'the  problem  of  the  operation 

I  '■  ■  ■  i 

[of  ayatems  which  are  capable  of  reacting  to  complex:  sets  of| 

ksighaln*  > 

i  The  work  of  Chlbertnon  /29/  which  is  analyzed  In  f 

f 

^ 

iChapter  2  is  of  Intei'est  in  consideration  of  these  problems;, 

S  '  ,  .  ; 

i'Even  though  the  activity  of  the  coirmlete  robot  may  be  highly 

i  ^  i 

jcomplex,  It  lE  still  fully  deteriii^ned  by  a  system  of  '‘uncon-h 


d i t i one d  r g f 1 a  xq s ”  ( the  program ) , 


I  We  Btrass  once  more  that  the  development  of  new  | 

|prograinE  is  Impossible  for  a,  system  organized  in  this  way,  ^ 

!■ 
t 

f 
( 

I  CimPTSH  lY 

SYSTEMS  (;APA3LE  OF  XNDSPEKDSHT  DEYI^fOPMEiTT  I 

OF  NJ:^^  FHOGRAMS  FOR  TIlEni  OEEFdiTION  \ 

! 
I 


I  One  cf  the  most  impcrtaait  problems  of  cybernetics 

( 

•lls  the  -oroblemi  of  study  of  the  Bo-*called  “self “organized" 

t 

jcontrol  systems,  vAlch  are  capable  of  independently  workl2ig 
lout  new  programs  for  their  operation.  Only  the  basic  pur- 

I  poses  of  its  activity  need  to  be  fed  to  aiich  a  systerfi..  It 
Bhoulci  poDBosa  the  capacity  to  find  the  optimal  method,  of 


’i 

'S  ^ 


npk^uu-.'WcmM^.V 
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? 


_ ..^.^.g-iaagatww-a^^  1 


iBolution  of'  a  Ti&v!  p2:’obleni  piao0d  bef'or’e  It  by  Itself  in  the  < 
process  of  Its  operation*  Eere,*  tlie  ^method  of  solution 
imay  be  an  extreinely  complex  sequence  of  operations  (coe!.- 
brands)  which  are  carried  out  in  response  to  the  appearance 
|of  certain  external  signals  ’(the  complex  program  of  opera-  ^ 

[t5,on),.  Hie  concept  of  ’*the  purpose  of  the  operation”  litayy  ; 

I  -  '..u 

fhowaverj,  include  supplesientary  conditions  related  to  the 

f  ■  ' 

jnecesslty  of  avoiding  certain  states  and  situations  which 
j-might  result  in  breakdown.  The  machine  may  find  It  neces- 


isary  in  the  process  of  working  out  the  program  of  its  ac-  ' 
Itivlty  to  set  up  new  intermediate  goals*  As  a  whole j,  the  ;? 

I  ,  ij 

Iprocess  Is  extremely  complex,  | 

Analysis  of  the  principles  of  operation  of  the  | 

brain  Is  of  decisive  significance  in  study  of  this  problem, | 

/ 

One  of  the  basic  properties  of  the  brain opera-  | 
tlon  is  its  capacity  for  designing  new  forms  of  behavior.  ! 

When  a  new  situation  arises  for  a,n  animalj,  new  f 

\ 

foriTiS  of  behavior  also  appear  to  fulfixl  its  needS',  l 

j  A  scientific  analysis  of  these  properties  of  the  j 

Ibraln  was  given  in  the  viorks  of  l.P,  Pavlov  and  hxs  j 

1  ■  '  ■  ^ 

jotudants  /2^ 4, 19^ 21^37/.  4  theory,  was  created  to  account  * 

for  certain  complex  forms  of  operation  of  the  bro<in»  Ihe 
ba.slc  proposition  of  this  theory  5-S  that  the  formation  of 


icomplex  conditloned-reflex  .systems  forms  the  basis  of  the 

i  -  ■' . - 
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fiew  nom^lex  fovuv.  of  behavior  which  arise  in  the  life  pro 


feeasos  of  animals* 


A  method -which  Involves  placing  the  animsl  in  a 


jopeoial  chamber  was  used  to  study  this  phenomenon*  Here  the  I 
■  basic  Idea  y:ae  that  the  animal  would  be  isolated  from  its  | 

Jnatm^al  -environment  and  it-  would  be  possible  at  the  same  I 

f  r 

|t:imo  to  appl'y  different  disturbances -to  it  in  the  forrrt  of  | 

Jvarious  signal  complexes*  .  I 

I  I 

I  Tl'nl  s  method  made  it  possible  to  reveal  the  basic  I 

I  '  '  ] 

}r3lGtlon,ahlps  vfhicli  characteriiie  the  development  of  new  t 


I  forms  o,^  behavior  (new  systems  cf  conditioned  refle^sss) 


I  ■  .  llie  basic  points  of  the  doctrine  created  by  I*p.,  ,1 

I  ^ 

[Pa-vTov  and,  hio  school  concerning  the  operation  of  the  cera-^ 

bral  hemispheres  ai>o  widely  recognissed  /5^i;>2,.b,l9^1?0j,21,37,/j, 

In  view  of  tills  we  shall  not  dwell  in  great  detail  on  this  1 

C 

problem, '  i 

f 

■  ■  ^ 

The  inve.3tigatlons  carried  out  In  this  direction 

by  P,,K,  Anokhin  resulted  in  tlie  creation  of  the  concep'U;' of 
■Che  ’"a.ctlvity  acceptor"  .and  "return  afferentatlon"  /2,3j5/. 

According  to  these  concepts^  the  simple  soheme  of 
the  reli'.ex  arc  should  be  supplemented  by  an  important  eo.m- 
|pou€nc.  This  component  is  rendered  necessary  by  the  fa-ct  ^ 
that  after  execut5,ng  a  conditioned-reflex  reactio.n.j,  the  1 

|anJirial  must  obtain  Information  concerning  the  result  of 
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jthle  activity^  This  information  ariEt  then  Toe  compared  -with  I 
I'some  eriter^lon  -whi-ch  has  ..been  created  earlier  in  the  brain  j 

jand  which  would  permit  evaluation  of  the  micceiSB^  or  failure 

i  ■  ■  ;■ 

of  the  aetlvitv  which  has  been  carried  out*  The  arxlmal  shoii  ■. 

I  ■  i 

jeither  repeat  this  activity  '(^-^  case  of  a  negative  eva.lus*”  ; 

t  .  s'  '  •  .  .  f 

|tion)  or  past  on  to  so3ie  new  activity  in  accordance  with  ^ 

Ithe  resul-ts  of  the  evaluation*  r 

!  ’  “ 
The  Ideas'  of  P,K*  Mokhin  supplecant  the  coi'fcept  of^ 

the  nj:3cha,nt.SH  o.f  the  closed  refle.7s  arc  wh'ieh  wa.3  created  | 

.1 

before  his  timei-this  provides  for  eonslderobion  of  a  re-  | 
flex  system  b.m  a  unified  cotflplex'  in  'which  tlie  T&iiUsBfalQn  ,| 
of  one  link  of’ the  conditioned  reflex  provides  a  requisite  | 

i 

for  the  tranEitlon  to  the  next  llnky  I 

I 

The  doctrine  of  T*P,  Pavlov  /pV  concerning  the 

t 

SYStereatic  nature  of  the  operation  of  the  cerebral  hem.!-  ,  [ 

:  "  ■  '  '  I 

I  spJisres  Is  of  great  slpnif  Icance  In  the  study  of  this  I 

I 

pro'bleiri*  It  eliminates  the  one-sidedness  of  gestalt  psy- 

o.hology  and  be-havioriSH  a.nd  creates  a  basis  for  jasberial-  | 

istle  study  of  the  complex  forms  of  the  brain^s  operation.  | 

I  I 

I  Interesting  x-ssearch  in  this  direotion  has  teen 

I  ■  .1 

icorrlad  out  in  the  laboratories  of  P.S.  Kupalov^  LJ), 

'I  ‘  ^  1 

p/oroninj  and  S.*M®  Braynes*.  | 

ReEearches  carried  out  by  L.Ct*  Voronin  /Sl/,  P.S,  I 

Kupalo5r/37/^  S.M.  Braynes  /1^^12/,  >hA,  Rokoto'v  /55A  A,V*  j 

.  - - - - 
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'ijUfiTT mfniir  nmyi  am 


— tif  -r~  »t-Tn<ifri‘  i[irtiiMUiin|ii-«->i  .ffli  fif»?^rTiiiii 

^apalkov  /^9>-T-‘^/j  K.A.  lordanis  /l^/j  I* A*  Alekeeyeva  /l/> 
ind  others  have  been  devoted  to  the  laws  of  development  of 
oomplesr  systems  of  conditioned  reflexes  in  vairions  species 
of  animals  and. also  the  complex  phenomena  and. relationships 
ivjhich  app-ear  on  studj*'  of  conditioned  reflex  systems, 

■  Recent. ly^  certain  Ecleiitists  have  proposed  a  s.harpe| 

* 

'demarcation  bet-wcsn  the  concept  of  the  ’-‘classical-  salivary 
|condltioned  reflex"  of  !•?,  Pavlov  and.  the'. concept  of  coa™ 

i ' 

iplex  systems  of  motor-  reflexes  as  a  more  complex  phenomicnon 
fin  the  behiavlo.r  of  animals, 

Ij- 

I  In  our  opinion,  there  is  no  basis  for  such  a  de- 

s 

marcation,  eince  I.P,  Pavlov  applied  the  term  ”c6nditlo.n3d 
*  ♦  ,• 
reflex"  in  a  'broad  sense.  He  repeatedly  stressed  the  com.-' 

ple.x  " sys tend. c”  character  of  the  activity  of  the  cerebral 

hemispherec. 

'i 

I  Together  with  this  we  feel  obllsed  to  stress  that 

r  ■ 

{  \ 

I  the  con-fcesTipcrar-y  development  of  science  and  In  particular 

I  the  development  of  the  thcjory  of  self- organ Isod  control 

! 

js-ysteiris  poses  a  number  of  new  problems  and  in  many  cases 
requires  both  broad-scale  theoretical  consideration'  of  the 
rolslem  and  the  development  of  new  methods  of  inve3tlgatior|, 
Study  of  the  laws  covering  the  development  of  a 

I 

|System  of  conditioned  reflexes  under  experim-ental  condi- 
I'tlons  frequently  does  hot  sol've  the  problem  of  the  possl 


jp2 
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,*  •  ■  -  ’' .  « 

directions  of  formation  of  this  mrstem  xmder  the  j 

r  ”  ■  .  '  I 

|jonciltions  of  the  life  of  the  animal  In  nature.  In  the  ; 

Utns©  of  developing  a  circuit  of  reflOTS,  tb®  experimenter. 


l5o®s  not* apply  a  whole  series  of  artlfieia. 


disturbance  S' r  '  I 


pie  cuts  in  various  signals  at  certain  momentB  of  tln^e  and 
ki  certain  order^  he  induces  -a  given  niotlon  at  a  moment  euit-r 
able  to  Mm  and.  so  forth.  These  stimuli  may  be  absent  under  I 

f  '  '  ■  ^ 

it'he  actual  living  condltl.ons  of  the  animal.  I 

1  ■  ,  ^ 

j  Olxe  study  of  -the  laws  of ,  forraation  of  complex  re-  | 

Iflex  systems  has.  taken  shape  in  a  definite  Bclentl-fic  di-  | 

I'  'f 

rection  having  .specific  teciBiiques  and  problems  of  Invcstl-J 
|gstlon.  From,  the  viewpoint  of  the  problems  of  tii^  dlrectioni 
iof  science,  the  use  of  aethod.6  of  investigation  which  facili|" 
tate  the-  d®velot5m.e,nt  of  reflex  systerrts  Is  necdEsary  and.  | 

I 

f;illy  Justified.  'j 

\  '  ■  I 

I  However  In  working  out  the  broader  th€;orettcal  probf 

{  '  ■  '  '  • 

[lem  of  study  of  the  operaHon  of  sc3.f -organised  control  | 

r  ^  ,1 

svFtems  It  becomes  necessary  to  take  rigorous  accourit  of  | 

'  .  ! 

evex’y  operation  performed  by  the  experimenter  In  the  course| 

of  the  experlRient »  It  also  becoiT>®s  neoesBsry  to  consider  [ 

ibf>  influence  of  motions  of  the  animal  on  the  external  me- 

■  “  '  ■  f 

|dlum  and  tho  presence  In  the  external  medium  of  a  certain  i 

k^sters  of  relationships  between  the  phenomena  which  deter-  | 

in.lne  t.hfe  appearance  of  new  signals,  .On  the  whole  we  en-  | 
■  I  Tharislator  *  s  note  :  Thus  in  text _ _ _ 


tenatnfr 
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bountered  a  new  problem  of  {jtwdy  of  the  complex  pattern  of  1 

I 

interaction  between  two  Interrelated  and  Interacting  oy sterna 
the  erivlroniswnt  and  the  organidm*  This  problem  is  no  longer  ■ 

> 

jinherently  part  of  the  field  of  physiology  and  is  one  of  th 
jmcst  Impor’tant  ooiriponents  of’  neurocyberneticjs.  Moreover,  the 

J 

jsolution  of  this  problem  is  'of  essential  valne  for  study  of 
jths  brain’s  operation.  This  problem' Is  closely  OiESoctated  j 


I'wlth  the  study  of  other  problems  of  cybemeticspspeolficall|j 

I  ■  '  '  i 

the  study  of  the  laws  gcvernlng  the  processing  of  ex-  < 

ternal  Inforraation  in  the  process  of  formation  of  new  con-  | 

't 

}• 

dltionod-reflex  systems^  w5.th  the  problem,  of  detecting  the  j 

oorre spending  algorithms/ .  with  the  problem  of  selecting  | 

■I 

''uEefal”  infcrm,3tion  from  the  over-all  flux  of  Information  | 
entering  the  brain  and  with  a  series  of  other  problems. 


a)  Interact.lon  of  Two  Systems  (.Brain  and  E'nvironment ) 

The  form.ation  of  a  new  conditioned-ref  lex  chain  is 
accomplished  as  a  result  of  processing  of  the  information, 
which  arrives  from  the  external  medium  in  the  form  of  com- 
D"!ex  setP  of  Dtimull  which  act  on  the  sense  organs,  How- 

I 

s'vei'j  the  input  of  Infoimnatlon  into  the  brain  Is  al.so  de~  i 

! 

;pend€nt  on  the  motor  reactions  which  the  animal,  performs  1 
|ln  the  process  of  forming  the  reflex  chain.  | 

j  i\ny  motion  directed  towa.rd  a  change  in  the  envlron-l 
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faent  results  in  the  Input  into  the  brain  of  a  new  fliuc  of  | 
I  f 

Itnforffiatlon^ 

I  In  a  number  of  ease Sy  the  acquisition  of  certain  irn- , 

i  -  '  ,  s 

iportant  Information  is  altogether  impoBSlble  without  the  ; 

F 

brganlsffik,  asserting  some  sort  of  action  on  the  external  me-— 
Idium  surrounding  it«,  For  example.  It  is  well  known  that  a 

may  be  obtained  by  striking  a  mtch  on  its  match  box,^ 

\ 

iHoweverj  Information  concerning  the  poBBlbillt^/  of  obtaining; 

1 

if  Ire  rfiay  b'S  obtained  onl5i'  when  the  man  has  made  the  active;  ; 

potion  related  to  igniting  the  match,  | 

I  It  must  be  emphasised  that  If  animals  were  to  per-  f 

I  ■  ■  I 

jform  six  the  motions  which  they  are  capable  of  performing  j 

by  virtue  of  their  physical  organisation  and  if  they  rs-  | 

membered'  all  the  information  which  then  ai*rlved  from  the  j 

\ 

external  environment^  then  the  formation  of  a  new?  purpoBlve| 
behavior  form  would  obviously  be  impossible  because  the  | 


oral 


In  would  be  overloaded  with  &  tremendous  quantity  of 


unnecessary  information,  ’  | 

The  most  important  singularity  of  the  brain operaj 

I 

tion  is  its  capacity  for  selecting^  sensing  and  storage  of  | 

I 

only  that  information’ which  is  necessary  to  satisfy  certaini 

^  .  •  •  i 

? 

tequlrements,  } 

i  "  '  '  I 

I  Another  Important  singularity  of  the  brain  is  the  | 

i  'I 

ffact  that  In  the  formation  of  new  behavior  patterpSy  the  f 
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j  ■  .  \ 

feriiracls  clc.  not  perform  all  the  possible  motions,  but  carry  | 

1  ■  ’  i 

put  thalr  motor  react iona  tn  a  certain  opti.TRal  seque-ncs?  (&g4 

I  '  .  .  ' 

Icordlng  to  definite  rulca)  with  the  reeult  fcha.t  ob- 

I  ■  i 

jtain  the  mxinram  quantity  of  '’useful’'  Infcrmation  with  a  f 


yrlnlmimi  number  of  trial  motions, 


Here  the  nature  of  the  new  trial  motions  ‘which  are  i 


|carr'?e<3,  out  depends  in  a  corntplex  manner  on  the  nature  of 
|the  information  arri‘'/ing  at  the  brain  as  a  result  of  the 


iprevious  mot'lons,  ? 

^  I 

I  llje .  comp]  ex  pstterr  of  Interaction  between  the  en-  ] 

!  ■  ^ 

mironment  and  the  brain  arises  in  this  manner,  J 


In  Bpeah'lng  of  the  external  mediuia  suri“oundj,.r:g  tJ'ie  | 

animal,  wo  wish  to  introduce  a  certain  refinement.  Usually,  \ 

I 

th::i‘  brain  enters  into  interaction  not  with  the  entire  "ex-  I 


iternal  medium"  but  only  w5.th  a  certain  part,  of  It*  Ab  a  f 

I  ■  '  I 

Ires’alt,  I't  is  moi-e  convenient  to  speak  not  of  the  external  i 
* 

Imell'um  but  of  a  certain  "field  of  activity"  /dry,  tliersby  I 

I  ■  I 

limiting  the  field  of  acti.vity  of  the  brain.  ’  I 


i 


A  elmi],ar  system  of  interrelationships  is  observed  .t 


in  the  operation  of  the  machines  that  control  the  operatio 


iori 


y:'f  industrial  unidertakings ,  In  this  oaBe  the  control  pro-  j 

■I  i 

fcesa  pre.3uppo36iS  the  existence  of  interaction  betwoen  two  I 

^  i 

llnter'i*elated  systems  —  the  controlling  system  and  the  ob-  | 

I  .  ,  I 

i  ■  '  ■  ’t' 

Uect  controlled  by  it  (the  field  of  activity  of  the  sygtem)|. 
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I 


Tlie  process  of  control  consists  3.n  the  application  | 


[of  a  certain  infiusncs-  by  the  controlling  system  on  the  ; 

B  '  •  '  -  • 

Icontrollec!  object  with  the  resiilt  that  various  types  of 
i  ’  •  ■  .  ‘ 

[changes  occurs  It  IB  the  information  concei^nlng  these  ? 

i  ^  ,  I 

(changes  which  is  fed  into  the  control  system  t'Mt  forms  the' 
I'"  '  ■  .  f 

[baslB  on  which  a  self-organlised  control  system  can  develop 

ia  new  ontimiHa  mode  for  its  activity.  . 

■f  ■  ,  •  V 

I  In  view  of  this.  It  sseitiB  convenient  to  us  to  con- 


jsider  the  problem  In  its  general  form,  on  the  level  of  study ^ 


^nf  the  interaction  of  two  systemBj*  one  of  which  (the  brain  | 

s  ■  .  ■  i 

or  the  control  system)  pi^o cesses  information  arriving ' from  | 

i 

outside  in  the'  course,  of  its  a,ctlrlty  and  coKs>dses  a  pro-™  j 
gram  for  its  operation  (a  system  of  conditioned  reflexes)  .| 

■  ■  '  I 

on  the  basis  of  th3.s  Informtloiu  The  other  system,  may  be  | 

■  t 

ref  err  sd  to  as  the  controlled  system  or  3,  to  use  other  ter-  | 
r&inoIC'gyj,  may  be  termed -the  "ada.ptive  field  of  actxvity"  of| 

r'\  •; 

the  control  system  (external  mediuiii),  ? 

Let  U3  suppose  that  some  control  systeja  is  capable  j  , 


of '  performing  operations  0^  j, h^j, b-. ?  bj|_. ,  and  senses  stlm-  | 


uli  (informatton)  which  arrive  from  the  object  of  control  i 


■I 


fin  the  form  of  signals 
I  The  control  system  (the  brain)  mtist  perfoi’m  a  car- 

|ta5-n  task  in  the  course  of  its  activity.  In  Its -general 
Iform  thi.s  task  may  'be  expressed  as  follows?  the  system,  must 


I- 


R 
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4' ' 


ps3  a  cartaln  B^quenoe  of  operations  to  obtain  a  certain  J 
kesftSfi-ary  eta1:»‘  of  th®  oontjfoiled  object  (the  e-STtei’iiel  rae .  ^ 


Kj-fl 

•TV.  4 


L«^t  ua ,  s’uppoBe-  tha't  the  external  mcvdliim  contains  a 


certain  poasibllity  of  attaining  ”k‘'^  by  .raeans  of  a  definite 


lEjatem  of  operatlonB*,  ‘Eiic  possibility  miy  be  expreseed^  for*; 


i 


jexaiiiple,  by  the  foliotd-ng  soham^t 


|b^-4c. 


This  Eig:nifi€‘3  that  for  the  stit©  "k”  to  arice  in  | 


ithe  environjaent  (controlled  system)  it  tB  neceBEary  to  carry 


t  a  -whole  aeries  of  succe 3 aive  operations  t  • 

Here,  eaoh  of  the&e  operations  must*  fee  performed  1: 


1 


I 
I 

[response  to  the  appearance  of  a  certain  Btlsmalus 

I 

^'(1  etc*  i 

11  o  o 

Tl'ils  possibility  is  itself  determined  by  the  syste'itf 

I 

■of  laws  -which  exists  in  the  envlronn^nt^  as  mill  as  by  the 
character  of  the  operations  which  the  anlsial  i.e  capable  of 
'psrfomyiing* 

We  consider  It  iBpiortant  to  stress  thiat  this  pos¬ 
sibility  exists  objectively  and  ttiat-  the  process  of  dev 
ing  a  new'  program  of  operation  may  be  red'ucod  to  the  Iden- 
ftification  of  this  syatem  of  laws. 

Th.3  deyelopK.enf  of  a  new  prograKi  of  operatloii  is 


w'.^xaUMWUVv'rfMWa'^ 


89 


kccoK?pl5,B.hsd  iindar  these  conditions  as  a  r-esixlt  of  operatlor| 


|3f  the  eontr-ol  system  on  the  ©xterrial  envlr^onment  (the  oh-  | 

f  ■  ■  ■  . 

beet  of  control)  and  processing  of  the  infoniiatlon  that  , 

?  •  ■  •  > 

jarises  ae  a  result*  In  the  ‘ slicplest  case  the  control  systeml 

perfcritt^  one  after  the  otherj  all  poBSlhle  , 

f '  ^ 

If'comnlete  sm>rey)*  Let  ns  analyse  the  poBSible  results  of 

I  ' ' 

jemploying  this  principle  of  activity?  let  us  aasume  tl'ia.t  th| 

fcontroi  s'vstem  hegins  to  perform  in  sequence  all  of  the  pos|' 

f  "  ■  I 

sible  operationE  or  b^jbgj,  etc,  | 

As  a  result  of  these  operations  certain  changes  o<2”'] 

i 

cur  in  the  object  of  control  (the  external  medium).  Infer-  j 

-  j  i 

mation  concerning  these  changes  enters  the  control  syscem  ■, 

in  the  foimi  of  the  signals  or  complexes  of  signalr^^ 

I 

for, example  | 

A  new  program  of  opersitlon  whic'ii  leads  to  the  at-  | 
‘tainmant  of  the  goal  ’*k’‘  (food  and  water)  should  arise  on  | 

I  the  basis  of  the  results  of  processing  this  Information,  I 

I  ■  :! 

bln  analyzing  this  process  it  must  be  remembei'od  that  in  ad“| 

■  ^ 

dltion  to  the  individual  reactions  the  system  will,  have  to  j 

jexp.erlenee  vEriants  of  the  various  reflex  olmins^-  e,g,,, '  I 


bo  or  ap™'— bvy^— a*/— — and  so  for  u-h^.  | 

O  4  D  o  p  /  O  4  I 

In  this  case  judgement-  of  the  correctness  of  one  I 

or  another  chain  will  h&come  possible  only  ¥Jhen  the  pheno-  j 

§ 

^iienon  ”k*’  appears  In  the  environment  (attainment  of  the  | 
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^oal).,  only  when  the  coziti*ol  eystem  (brain)  accident- | 

1  '  1  i' 

klly  performs  the  correct  sequence  of  activities  j.ao>  i 

ko>a^.^hr,,a,,.7>K  -4t  after  a  long  period  of  testing  the  varl- . 
foiia  pooBlble  behavior  variants.  The  theoretically  possible  | 


inumber  of  variants  which  the-  control  Bystem  must  test 

f  ■  '  t 

lit  accidentally  stumble s  on  .the  proper  variant  can  be  cal™  i 
?  ■  ■  '  '  ■  ' 
Iculated,  11.10  p.roblem  corislsts  In  the  choice  of  t.he  sole  cort 

1  ^ 

jrect  variant  from  among  an  extremely  large  number-  of  poB™  | 


Bible  va,riants,  Stich  a  problem  Yi&b  been  analyzed  in  si  spe¬ 
cial  report  by  Achby  /6l/*  He  arrived  at  the  conclusion 
tlmt  a  complete  sun/ey  of  all  possible  variants  would  re¬ 


I 

I 

I 


quire  an  astronomical  outlay  of  time  and  would  prove  ini-  | 

I 

possible  in  practice,  A  special  model  of  the  boineoetat  tte.t‘j 
adjusts  itself  by  way  of  a  com.plete  survey  of  variants  hat?  | 

been  created  for  study  of  this  problem,  | 

. 

A  report  by  Ashby  /6l/  indicates  certain  direc- 
tiens  which  may  result  in  shorte-nlng  of  the  time  for 
■selection  of  the  necasaary  variant.  One  of  the  important  | 

I 

factors  wiblch  provides  for  a  shortening  of  the  seleGtlon  | 

f. 

time  IB  the  operation  of  certain  qualitative  relationships  j 
in  the  ourroxaiding  external  mediuia.  As  a  consequence  o.f  | 
these  relatlonshlpE.-not  Just  any  of  the  stimul.i  (a- 

J.  4C.  3  I 

f 

ibut  onlv  strictly  detertd.ned  slgnale  may  arise  in  responee  I 

I 

to  the  performance  of  3om.e  action  a,,  'B'nis  reduces  the  I 

a  I 
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I •"• — "  *'  ™-.—  -  ^ 

I  tijae  ©pent  in  £?ux*Yeying  the  vai^'iants.  We  wnst  aEcmne 


I  S'l  .is-n' f icance  to  the  fact  that  as  a  result  of  tha  exis- 

i 

I  tence  of  S7/st.em8  of  external  relationships^  and  as  a  re-’ 

‘‘  suit  of  the  existence  of  the  continual  processes  oi  rao- 

I  tlon  and  transformaticn  yhtch  charactarisi'e  the  external 

!  ohjeotlve  world,  different  signals,  including  the 
I  '  ■ 

I  etc,,  which  enter  the  reflex  chain,  will  appear  wjith 
j  a  certain  probability  at  all  tiiRes  in  the  wsedium  surround-’ 

j 

ing  the  wian  or  the  animal  * 

The  probability  of  tJie  appearance  of  these  signals 
depends  on  the  degree  of  organization  of  the  external 
j  rwsdluun,  on  thet  ability  of  the  animal  to  perfarfii  various, 
j  motions,  and  on  other  factors The  appearance  of  various 
I  signals  in  the  external  medltufi  may  be  of  great  signifl^ 

!  cance.  Special  techniques  employed  by  the  animal  may  be 
I  used  on  the  basis  of  this  phenomenon  to  achieve  a  sharp 
I  reduction  of  the  number  of  trials  made. 

In  this  manner,  we  aprive  at  the  conclusion  which 
has  importance  for  us — ^namely  that  not  only  the  study  of 
I  the  .brain,  but  also  examination  of  the  basic  forms  of 
I  interaction  of  the  organism  with  its  ©nvironiaent  is  of 
j  decisive  importance  for  consideration  of  the  problem  of 
I  self-organized  control  systeias. 

I  According  to  the  basic  tenets  of  dialectical 

L 


mittflHi- 
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niaterial isms  highly  complex  syBtema  of  cause  and  effect  I 

'  '  '  f 

relationships  among  the  Yarious  elemente  of  the  externa]  f 
medium  have  an  objective  existence  j.n  It*  This  doctrine  , 
proves  important  In  study  of  the  system  of  interrelation-  j 
ships  which  arises-  betv^een  'an  organism  and  its  environ-  |, 
ment  In  the  process  of  developing  new  conditlonedr-reflex  i 

I 

chains*  As  a  consequence  of  the  existence  of  a  complex  j 
system  of  interrelationships  in  the  environments,  the  iro-  | 

tlons  performed  by  anljuhip  may  give  rise  to  a  v^hoie  chain  | 

: 

of  reciprocally"” related  proccsEesj  the  result  is  the  in-" 
put  of  a  large  quantity  of  heterogeneous  new  information 
into  the  brain ,  ,  ! 

The  higher  the  degree  of  ’'organisation''  of  the  I 
envi.ronraent,  and  the  gi’eater  the  extent  to  'which  causae.  I 
,and".effcct  relatlonEhips  prevail  in  the  en'vlronmsntjf  tlie  | 
greater  will  be  the  quantity  of  information  obtaii'icd  b-y  | 
the  animal  in  response  to  the  motion  that  it  performs,  | 

„  ■  ■  I 

if:  ircist  also  be  -taken  into  account  that;  tlie  en-  | 

I 

vlronrGant  is  in  a  state  of  continuous  -change  and  motion,,. 

- 

This  point  l8  liTiportant,  sinco  the  conclusion,  that  an  | 

\ 

animal  can  obtain  certain  information  pertaining  to  the  | 

InterrelationshlpB  prevailing  in  the  environment  even  I 

■  f 

- 

■without  performing  some  active  motion  proceeds  from  It* 

The  discussion  presented  suggests  the  possibility  of 


-  nv-iryf."- 
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j  reducing  the>  nmaber  of  trials.  It  is  Important  to  stress, 
I  however^  that  a  reduction  in  the  number  of  trials  cannot 
I  be  attained  a^itoms.ticallyj  for  this  piirpose  it  will  be 
j  found  necessary  to  use  special  ’'procedures*'  v&ich  are  rs- 
i  lated  both  to  a  definite  sequence  of  motions  perforirad 


I  by  the  animal  and  to  the  use  of  certain  principles  in 

1  selecting  the  information  arriving  from  outBide,.,  The  ; 

question  arises  as  to  a  certain  definite  rational  crg^an- 

iration  in  the  sequence  and  character  of  the  disturbances 

(trials)  which  the  self-organising  system  applies  to  the 

controlled  object  during  the  period  of  "self-'-edixcation” .  .i 

The  question  as  to  the  criteria  for  evaluating  | 

the  usefulness  of  the  various  motor  reactions  acquires  j 

a  great  significance »  ! 

1 

Together  with  this  we  encounter  the  problem  of  i 

i 

creating  a  certain  evaluation  system  for  selection  and  j 

'f 

f ideation  in  the  memory  of  only  that  information  in  the  ; 

stream  of  Information  arriving  fi'-om  the  controlled  ob-  \ 

I 

Ject  which  may  prove  useful  in  the  attainment  of  the  \ 

goal  ’’K”  which  has  been  assigned  to  the  system  in  ad-  1 

! 

I 

vance .  ; 

I 

The  appearance;  in  the  course  of  the  "self-  ,  j 

teaching”  process,  of  interinedlate  guide  points  which  I 

I 

would  permit  the  evaluation  of  the  usefulness  of  the  | 
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I  various  ipot  j.ons  and  the  importance  of  the  va.rio'as  3.n« 


formation  eoKting  Into  i;he  brain  would  evidently ,  he  of 

I  gi^eat  slgnificanoe  for  the  solution  of  this  problem* 

} 

I  Thus  the  problem  arises  of  seeking  out  a  certain 


sequence  in  the  oontrol  systems  operations  which  would 


I  permit  its  rapid  and  accurate  development  of  new  operat-  f 

I  .  ’  .  I 

(  ing  pi:»ogra3is  (new  reflex,  chains)  ■without  making  an  ex-  | 

^  .  I 

i  ha'ustive  survey  of  al.l  the  variants*  Tlriese  operations  I 

\  ■  ■  ■  ■  i 

i  ■  ■  ■  I 

j  must  oliVlo'usly  Irxclude  both  definite  rules  for  the  ap-  j 
I  plication  of  distisrhanees  to  the  controlled  object  and  ■> 
I  definite  rul.es  for  the  evaluation  and  processing  of  the  | 

1  ,  i 

I  information  arriving  frc,m  outside.  Here,  of  course,  | 

each- successive  action  must  he  determined  in  a  complex  I 
Manner  by  the  resul-ts  of  the  preceding  actions,  |’ 

I 

As  vmE  coi*ractly  noted  by  A,  A,  Lyap>im6v  /4o/,  | 

here  we  speak  of  the  problem  of  finding  the  algorithms  | 

:  i 

:  of  operation  of  Belf-organljsed  control  systejES,  Here  we  | 


encounter  the?  problem  of  stiidy  of  *'hlgher-c.stegoi*y’*  S'l*' 


gorlthiiis,  algorithms  on  the  basis  of  X'^M.ch  new  operating 
preg'rams  (reflex  chains)  may  be  worked  outj  in  other 
•words,  algorlthras  which  make  it  . possible  for  t.he  control 


system  itself  to  find  the  nev;  'and  different  information- 
prccesalng  algorithms  which  are  necs-ssary  under  the  new 
conditions  of  operation  of  the  cybernetic  eyatem. 


* 


[  .  'TIliB  prol'Ies.  is.  also  of  vital  tmpoz“tan«5  ^for* 

5  ",  'I 

I  eases  in  whieh  the  coritnol  Bjntem  which  already  has  a  i 

I  definite  prograiii  Kiyst.  tah-e  its  ^‘KiistakeE*^  into  aocoUiivj 

i  f 

I  ajid  find  .ways  to  fellKilnats  thss.  ? 

:  The  bra5.ii  ■oosass.ses'-  such  algorithms,  Tliey  aro.Ge  ; 

I  ■  “  ''■■■■'  ? 

t  In  the  proceta  of  evolution  as  a  result  of  natural  selec- 
I  "  .  ■  '  ■  ■  ■ ; 

f  tlon,  ,  ■  ■ 

j  In  studying  tl^e  algor itlme  of  the  brain  *s  opera-  J 

I  ( 

I  tion^  it  is  iBsportant  to  renieB'ber  tliat  it  is  frequently  s; 

s  .  '.' 

I  necessary  for  a  control  systeift  to  work  cut  not  only  op'-  | 

I  e:rating  prograitis  in  the  foi*OT,  of  sequencer,  of  different  | 

actions  but  also  Kuch  nore  complex  progr’a»!h.  For  example j,  I 
I  '  i 

I  it  may  oco'ur  In  the  .operation 'of  a  chemical  enterprise  •  | 

tliat  the  p.re senes  of  some  substance  /retards  an  entlx»e  i 

{  .  ! 

1  cy stem,  of  cliemical.  reactions,  A  self-organlaea  controj.  [ 

I  iiJt'stesi  should  be  able  to  detect  this  subSuance?  anc.  then  | 

j  find  ways  to  ellm5,mts  it,  '  .  [ 

■  i 

Cases  in  which  two  independent  components  are  ■  i 

ncicespary  to  acsomplish  a  certain  stage  of  the  proces’rS  | 

rer-Y  be  tslten  as  a  second  ganeral  case  of  control-system  | 

■  ■  ■  i 

:  on«i>at-‘On.  For  e:xa.Eple«  the  Blmitaneous  presence  of  | 

''  -  ,•  -  ^ 

1  two  substances  (A  and  B)  , may -be  found  necessary  in  a  i 

\  ,  ,  i 

certain  stage  of  a  process  in  the  operation  of  a  chem-  j 

:  leal  enterprlEc.  The  self-organised  control  systems  | 

li 

_ _ _ _ 
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i  should  have  the  capacity  tos  a)  determine  Just  which  | 

I  •  I 

I  substances  are  necessary,  b)  work  out  a.  method  of  aC'-  | 
i  quirlng  the  substance  A,  c)  then  develop  a  method  for  i 

I  '  I 

I  acquiring  the  substance  Bj;  d)  only  then  will  it  be  able  | 

>;  tc  effect  full  development  of  the  optJ.mum  regime  of  op-  | 

»'  i' 

F  f 

I  eration  of  the  enterprise »  •  .  | 

f  ■  ^ 

[  In  speaking  of  these  more  coir^lex  eases  of  con-  | 

I  f 

!  ! 

I  troi-'System  operation,  it  miist  be  noted  that  physiologists  | 

I 

also  encounter  similar  foimis  of  operating-program  develops | 
ment  in  study  of  the  work  of  the  brain  and  that  the  study  j 
of  these  forms  of  operation  rarlses  the  question  of  seek-  i 

I 

Ing  out  more  complex  information-processing  algor Itl'irns  in  | 
the  brain*  I 


The  above  form  of  examination  Is  unuaual  for 
physiologists ,  Objections  are  frequently  raised  against 
the  uea  of  the  term  algorithm. which  had  not  previously 

I 

I  been  used  in  study  of  the  problems  of  development  of 

i  conditioned-reflex  chains.. 

In  this  connection,  the  authors  feel  It  Impor- 

I  tant  to  stress  that  the  problems  and  methods  of  InyeB- 

I  tlgation  of  neuroeybernetics  do  not' coincide  with  the 

! 

I  p.roblems  and  methods  of  study  of  higher  nervous  activity, 
i 

I  As  a  result,  it  is  found  necessary  and  helpful  to  use  con- 
I  cepts  and  terms  that  have  been  adopted.  In  this  branch  of 
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I Bclenoe . 

}  .  ■  ■ 

I  b)  Systematic  Prooeduees -for  Study  of  the 

!  InfoOTJBtion-Proce-sslne  Algorithms 

a 

•  5 

I  It  Is  found  necessary  for  study  of  the  problemB 

I  formulated  above  to  develop  certain  special  procedures 

j  of  in-vestlgatlon  which  will  permit  an  approach  to  study 

f  : 

I  of  the  ccmple>c  Interaction  between  different  systems, 

I  ”  • 

I  I'hese  systematl-c  procedures  should  provide  net  only  for 
scientific  analysis  of  the  Miork  of  the  brain  but  also 
for  analysis  of  the  variations  In  the  environment,,  It 
J.a  therefore  found,  necessary  to  reproduce  the  interaction 
of 'two  systems:  in  the  course  of  the  exi>erlr!ie:at ,  Any  of 
several  systematic  proccd^^res  may  be  used  in  carrying  out 
these  investigations..  In  one  of  the  variants^,  the  expert «•< 
mentor  .may  take  the  part  of  tha  external  mediiOTj^  by  not¬ 
ing  on  paper  prior  to  the  ex.periinent  a  definite  system 
of  “external  regularities".  Later^,  during  the  eXT^erlment,. 
he  must  apply  various  signal b  in  aeoordanoe  with  this 
scherss  and  the  motions  of  ttie  animal.  Hers  he  may  also 
j>rovlde  the  possibility  of  random  (independent  of  the 
motions  of  the  antmial)  appearance  of  various  external 
tiignals  and  establish  a  definite  probability  of  their 
appearance.  Per  example^  the  exper-imenter  may  apply 
various  signals  five  times  during  each  minuteJ^  in.  add!- 

I 

j  tlon  to  observing  the  other  rules.  Apart  from  the'  expert  - 

■{wageaK.w»WK*--i«Wiiiw<waiuM«*Wif  ■‘*Jivrr.M-JJ-rii.itu»TiittiWii.ii-ii:ntin.w«>-  iiuwm-i'njwwXK 
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i' iriisr.ter^  &n  automatic  device  w>?o0e  operating  program 

[ 

I  governs  the  appearaxiCe  of  the.  neoeBBar-'y  relat3.on,sh:lps 

’may  also  be  ttned  during  the  experiment b.  Certain  algori- 
I  . 

[  tiOTE  Of  the  bra  in ‘s  operations  may  be  detected  In  thl.s 

I 

1  first  stage  of  Investigation^ 

,  The  second  stage  of,  irivestigation  is  concerned 
with  farther  analysis  of  these  algorltliWE*  It  presupposes 
the  creation  of  an  Eutorii3.tlc  device  in  which  the  algorl- 
tluiis  detec-ted  in  the  ejq>&rlrfleiits  on  the  aniraals  should  he 
I  realisad.  The  final  purpose  of  study  of  the  operation  of 
I  the  a.u.torfis,tlc  device  shotild  be  to  detex'’r.!lns  whether-  these 

f  , 

1  algoritlims  can  actually  provide  for  the  development  of 
1 

I  nev;  programs  of  operation  for  the  system.  In  this  caeej, 

I  If  the  aixtomaton  were  to  prove  cap»able  of  indepsendent 
i  fox’ination  of  new  prcgrar.iE-  for  itn  work>  this  would  be  an 

i 

indicatten  that  the  conclusions  drawn  were  correct.  In 

I 

1  the  contrary  ease^  study  of  the  operation  of  the  auto- 

I 

I  .matic  device  vrould  permit  us  to  determine  whiit  coriSti- 

I  ■  ,  ^ 

I  t'lites  the  inadequacies  of  our  conce-pts  conceir-nin.g  the 
I 

I  algorithiijs  of  the  brain’s  operation  and  enable  us  to 

)• 

i 

I  mark  out  the  course  of  new  ©3cperlraenta  on  the  animals. 


I  In  cur  opinion,  therefore,  the  process  of  investlgatl.ng 

I  '  ‘  ' 

I  this  problem  must  include  several  jihasesjs  som.e  of  which 

I  would  be  carried,  out  on  animals  and  others  by  vjay  of  in- 
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i^estlgating  the  work  of  the  a.utorsatic  device. 

i 

f  study  of  the  operation  of  the  cybernetic  rcachlne 

I  nay  provide  anawers  to  a  number  of  Important  questS-ons 
I  relating  to  the  deteimilnatlon  of  the  conditions  in  which 

f 

S  a  glwn  algorithm  can  provide  for  the  formation  of  new 

[  operating  ni^ogramSj,  and  environmental  conditions  lender 

i 

t-  • 

[  which  it  in  Ineffective. 

I  • 

i  Experiments  In  which  studies  were  made  of  the  In,'- 

I  tt-raction  betw’een  two  radio-electronic  eystemsj.  one  of 
j  which  would  embody  certain  algorithms  of  the  bra:li’:hs  op~ 

1  oration  while  the  other  served  as  a  model  of  the  environ- 

I 

I  merit  and  reflected  Its  basic  properties,  might  alTC  be 
I  of  great  interest. 

I  In  our  research,  we  used  a  special  chamber  to  • 

I  conduct  the  physiological  part  of  the  experiment .  The 

f 

j  oT)erating  principle  of  the  chamber  Biade  it  possible  to 

j  apply  a  large  number  of  different  types  of  stimuli"-"- 

t  bells,  metronome  sounds,  etc.— and  to  register  a  large 
f  ’ 

I  number  of  different  motions  of  the  animals — Jumping 
f 

i  onto  a  pedesta,!#  pressing  a  pedax  with  a  paw,  etc* 

The  experimental  technique  made  it  possible  for 
the  experiment€*r  to  apply  the  various  sets  of  stimuli  at 
I  will,  and  to  record  all  siotions  of  the  animals*  It  also 
I  enabled  him,  to  create  different  systems  of  relationships 
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.•i-JB-l  r-i 


I  f s-!’-stemf^  of  ^.ntei^T^fclattonshipfi  among  the  various  stimuli,) 
of  vaif/ing  complexity  in  the  experlBiental  envlroi'iin6;nt 
about  the  animal.  For  exe,mple,  an  experii!ic.nter  wrote  down 
I  the  definite  schatnet 


hell 


_^l3ap  to  '  ^ 

pedestal  ;pedal 


[ThiB  Bcheme  represented  a.  definite  'system  of« 
r*®lationship3  which  were  artlficial-ly  created  in  the 
animal  *  3  environment  diirlng  'the  course  of  the  experi¬ 
ment »  Here  j,  the  experimenter  himself  pilayed  the^  role  of 
the  environment .  In  accordar.ce  with  the  movements  of 
the  animal;  he  used  this  sches^  as  a  guide  in  applying 
various  stlBiulio  If;  for  examiple;  the  animal  JuKiped  up 
onto  a  pedestal  whan  a  bell  was  rung,  the  experlRienter 
blew  a  whistle.  It  is  convenient  to  use  a  system  of  let* 
ter  sjuubols  to  char ac ter l52e  these  relationships.  For 
example,,  the  system  of  reflexes  given  above  may  be  re¬ 
presented  nicely  in  the  form  of  the  scheme 


a. 


«bg--’~food. 


1  “"1 

SysteffiB  of  relationships  in  vfhich  the  acquisi¬ 
tion  of  food  was  possible  ordy  in  the  simultaneous  pre- 

I  ■  ■  • 

I  sehce  of  t'!f?o  signals,  e.g.,  P.and  R,  could  also  be 

i  created.  We  present  the  scheme 


b- 


L_ 


‘2.’ 


■^1 


‘Ei 


liL. 


iiizzll 


•'5’ 


-ag  bg  - 


‘fool 


...>food 


101 


1  T-^  ^jll  be  seen  that  with  this  Bystem.^in  order  ,  | 

for  the  to  arise  after  the  movB-rmxit  h^s  It  j 

jwas  necesearj'-  that  t.!o  mutxially-independent  eignals  R  and  j 
[f  be  present  t  on  the  other  tend,  there  existed  ,  a  systeiH  j 


101'  reis 


latloiighipB  ttot  could  provide  for  the  appearance  of  j 


F  and  03 


Sthe  signal s  K  and  P  (a^  __  a^  bg  F  ^.tid  03  ^ 

i  i'  ’  "  ! 

|aj|  „  bj_|_-  : —  F.}«  i 

I  Aside  from  the  systems  of  rigid  relationships,  it  | 

was  also  possible, to  provide  for  the  random  appearance  of  j 

the  varicus  signals  (a^  etc.)  in  the  of  ^ 

tlie  experiment^  here  the  probability  of  the  appearance  of  j 

the  varlouB  signal B  could  bs  fl^*d  by  the  eKporlcerrt.er  at  j 

the  beginning  of  the  exper-traent ,  In  the  conrse  of  oux-*  ex-  -  ^ 

perlments,  we  provided  for  the  animals  an  arb.i,xic,l<i.l  en  | 

viror;.ment  that  was  under  the  control  of  the  experit)enter.  | 

Thi“  external  medluiTi-  could  be  modified  and  recon-  ^ 

...  .  ^  ^ 

structad  at  the  experimenter *s  wlrl»  | 

On  subjecting  hungry  animals,  to  these  condxtlons,  | 

we  observed  that  as  a  result  of  performing  a  certain  Be-  | 
quence  of  movements  and  using  certain  forms  for  processing  j 
e.xternal  information,  the  animal- woiild,  after  a  certain  | 
.period  of  time,  "divine’*  an  objectively-created  and  ‘'mi-  I 
Ifamiliar"  eystem  of  external  relationships  that  enabled  ^ 
llm  to  acquire  food.  A  new  conditioned-reflex  system  (a 

if  ■  ... _ 


102 


iiew  program  of  opex^atlon)  vras  vforked  out  on  thia  basis  to  | 
I  ■  ,-  s 

it  possible  to  obtain  the  nourishtr-ent  in  the  ahorteot  [ 

■  ■  !' 

jpossible  time*  ., 


m'iake 


I  "  In  conducting  these  experiment Sj,  the  .experlraentej;"  | 
I  '  i 
'knew  exactly  both  the  nature  of  the  external  relationships  I 


|and  the  nature  of  the  nev}  Bystem  of  conditioned  reflexes  \ 

i  ■  ■  i 

ithat  emerged.  He-  could  follow  the  appearance  of  the  various^ 

f  I 

? external  stimuli,  using  various  forms  of  the  experiment  I 

f  ■  ,  I 

(which  involved  the  creation  of  diffei^ent  conditions  in  the  | 

t  ^ 


lexteiaial  medium;,  the  expei’lirienter  was  thus  enabled  to  study 

i  .  ;1 

I  the  system  of  rules  in  accordance  with  which  the  movementgi 

1  i 

I  of  the  animal  were  carried  out,:  and  also  to  cast  light  on  | 

l  ■  I 

the  procedvires  used  by  the  animal  to  process  Information  | 
arriving  from  without.  In  this  manner.  It  becomes  possible  | 
to  Btxidy  the  algoritlmis  used  by  the  brain  in  developing 
new  forms  of  behavior  (the  new  operating  programs  of  the  | 

i 

■b:raln)  in  a  nevr  sltufx.tion.  | 

■  I 

The  second  stage  of  the  investigation  was  the  | 

I 

ci’aatlon  of  a  cybernetic  radloelectroniC  system  (  a  learn-  » 


Ing  automaton)?  see  Chapter  Y1  of  the  present  work.  The  I 

! 

basic  algoritiims  discovered  In  the  animal  experiments  and  \ 

■■  1 

underTyi;ng  the  foritetion  of  the  conditioned-reflex  chain  | 

I  I 

jiwere  embodied  in  this  machine.  In  the  construction  of  the  | 

iautomatlc  device,  made  it  our  goal  to  cleteivnine  whether  I 

’  ..  I 

I. 

I  j  ;i-ii[-m  iiriitwi.if  iir  in  "i^t"  wipwi  ii  n-rr  -ti  -  -  ^l|■l1-^lll  ■-  in~"i  --i  -  -n  ,  -  ■  • -i-, — 
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i 


^thsHC  algorittets  can  actually  provide  for  the  operation 


|of  a  Belf-organiged  s^/stem  and  to  study  the. process  of 

i 

jdevelopment  of  new  conditioned-reflex  .circuits  un.der 
[varlcua  conditions  and  the  nuitber  of  trials  neceEsary,, 
illew  physiological  experiments  were  then  set  up  on  the 
ihasis  of  tlie  results  of  this  study. 


9 

I  c)  InforKatlon“Proces3,J,ng  Relationships  Underlying  the 
!  Forr^tlon  of  a  Simple  Re.flex  Chain 


A  num.her  of  varlo-ds  algorithms  were  discerned. 


leach  of  these  was  optimal  undsi’  certain  conditions  and. 


inappllcahle  under  other  conditions.  These  algoritmas  were  | 


quite  complex^  and  for  now  we  shall  present  only  a  few  of  I 


I 


the  simplest  instances »  •  .  ,  | 

Let  us  consider  the  algorlthmis  which  come  to  light  | 

I 

in  the  development  of  a  simple  chain  of  reflexes  (a,lgorlthii| 
I  No.  1)  I 

X*  -  v. 

3 

where 


__  _ s,p  „  ^2  ■—  '^3  —  ^4  —  '^4 


foodj 


a.,  j) 


,  a  are  stimtili^ 
n 


,  ^  Cw/*l  * 

X  d 

h..  .  b,,  ,  ,  »  'b_  are  various  movements. 
1  d  m 


1,  The  animal  ■per.forms  various  random  motions 


I  fb  .  b.. .  .  .  .  b  )  and  senses  the  information  that  develops 

I '  !■* 

as  a  re.sult  (a^,  agj  .  . 

2,  If-  it  obtains  food  several  times  after  .some 
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jone  of  the  movements  (bi^)  (If  this  movement  coincides  |' 

|ln  time  on  seveivil  occasions  with  the  acqi.iisttlon  of  fooc!}^  f 

1  ■  .  .  .1 

jthen  a  )  the  nninher  of  random  movement s  diminlslies  .sha.rplys  , 

ifc)  the  animal  begins  to  Dorform.  the  movement  In,  very  ire-  | 
f  '  .  i 

hnently*  •  ! 

i  ■  '  .  f. 

I  6,  If  the  movement  invariably  coincides  with  j 

I  ^ 

ithe  acquisition  of  food^  no  further  eh.angeo  are  observed. 


I 


4,  If  the  movement  b^,  does  not  result  In  the  ac- 


[ousitlon  of  food,  or  does  not  always  do  so^  the  aniinal  be- 


Iglns  to  sense  external  Inforniation  a.^  .*»  ^r;^* 

I  ‘ 

I  some  stimulus  )  coincides  with  the  motion  and  the 

I  acquisition  of  food  several  tirae.Bj  then  a)  the  mcvement, 

fbj,  begins  to  occur  only  in  resnonse  to  the  signal  b) 

I 

ithe  animal  stons  receiving  external  stimuli, 

I  5,  In  cases  where  the  signal  appears  fr-e- 

Iquencly  and  coincides  with  food^  no  fur-ther  changes  are 

\  "  '  ' 
hob  served, 

I 


6,  In  case  a,,  (the  conditioning  stimulus)  has  not 


I 

I  appeared  for  a  long  period  of,  time  ox*  is  not  reinfor‘c€d,if 
Ithe  random  movements  reappear  and  the  infoxvaation  \ifhich 
arises  as  a  result  of  these  movements-  begins  to  be  sensed, 
7.  If  one  of  the  ra.ndojn  movements  (e.g.,  b^)  coin¬ 
cides  several  times  vrith  the  stimulus  (the  conditioning  | 
stirrralus)^  it  is  remembered i  a)  the  mimber  of  random  mo 


wjaw«.Mnv7KMinv‘n*»«'M^'r’ 
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2 


hloriB  lb., 

^  '‘I 


fc  )  f  0.116  off  sharply  I  h)  the  animal 
ni 


begins  fco  perform  the  motion  continually 


8.  If  the  movement  b^  does  not  always  coincide 


lln  title  with  the  appearance '  of  the  stlmulas  aj^  (which  re- 

iinforcec  this  r'eacti.on),,  the  animal  begins  to  sense  ax- 

jternal  signals  (a^  %)  arid  perform  the  move- 

rment  after  these  signals-.  If  the  appearance  of  somo 
id. 

■:  signal,,  e,g,j,  By  coincides  several  times  with  the  move— 
hment  b-^  and  with  the  appearance  of  t.hs  signal  a  ne'^J ' 

s'" 

I  conditioned  reflex  Is  developed.  Tlie  animal  begins  tc  per¬ 


ron- 


I  form  the  movement  b.^^  only  after  the  signal  a..^ 

Iditionlng  stimulus)  is  applied. 

Two  links  of  a  reflex  chain  are  formed  in  this 

I  manner , 

I 

\  These  rules  are  henceforth  used  in  the  develop- 

i 

jmont  of  more  and  more  new  reflexes.  The  new  reflexes  are 
!  now  woi'ked  out  on  the  basis  of  coincidence  of  random  move 
merits  with  signal  or  Each  of  the  conditioning  stlm-  j 
uli  may  become  a  “‘axipport''  for  the  formation  of  new  re™  i 
flexes. 

On  the  basis  of  tiiese  rules^  the  animal  can  figure  : 


i 


i 

’'outgone  by  one,  th-o  laws  of  hie  envlronraent  ana  thence 


iwork  out  new  optimum,  programs  for  its  activity  that  resulc  ^ 


^In  the  acquisition  of  x^ater  and  food  and  tte  satisfaction 


^  I 

i. 
I 


% 
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■of  other  needs  ^ 

i  ' 

I  The  algorithm  described  above  provides  definite 

1 

Icrlteria  fo^r  evaluating  the  usefulnoBS  of  the  actlvitleB 

\  '  ■  ■  ■ .  ’  i 

[pursued  by  the  control  ayetemj,  as  .well  as  the  u.Befulnesa  | 

f  ■  ■  ■ 

■of  the  Information  being  fed  Into  the  brain.  It  also  ! 

^  ■  ■! 
provides  £m  opporf.mity  for  selecting  and  memorizing  the  'j 

fuserui  movements  and  the  reliable  and  useful  lnforma,tlon.:  | 

•'  I 

1  At  firsts  the  basic  criterion  for  the  validity  | 

land  usefulness  in  thj.s  process  is  repeated  tlme-coi.ncidence| 

|of  come  nev;  stimulus  or  motion  with  foodj  later,  ?d.n  the  | 

course  of  further  formation  of  the  'system,  this  becomes  f 

t  ■  i 

I  the  repeated  tim.e-colncidenos  of  new  movements  or  signals  | 

Iwlth  one  of  the  conditioning  stimuli  of  the ■ earlier  links  I 
(condl'bioned  reflexes)  of  the  chain,  rnis  ori'berion  is  f 
fully  reliable,  since  the  occurrence  of  repeated  coinci-  | 

I 

dence  may  sex've  as  proof  that  the  organlBm,  is  dealing  In  1 

I 

this  case  not  with  random  coincidence  of  tx^o  signals,  but  I 

I  with  a  reel  lav^'  of  the  external  -world  (cri'terlon  of  cer- 

f 

Itainty),  At  first,  however,  the  informatlon'-usefulnesa 

I  I 

criterion  is  i:’epaated  coincidence  of  new  signals  with 
food,'  and  thereafter  with  a  conditioning  stlmuluB,  -which  j 
■was.  In  turn,  associated  with  food.  €arlie;r. 

This  algorithm  also  provides  for  th£^  emergence 

Iin  the  ''learning”  process,  of  new  guidelines  which  are 


|th8n  used  to  evaluate  the  upefulness  of  the  various  move-  j 
Le;n.ta  and  the  Iniportance  of  various  bits  of  Information.  j 


Ias  we  have  already  noted,,  such  guidelines  may  be  rep.oe»”  •  , 

I  '  ^ 

[sented  by  any  of  the  conditioning  stUriull  of  conditioned'-  j 

jroflex  systeae  developed  earlier  a2>  ag>  etc«j*  it  j 

ke  imno-^'tant  to  note  that  tlie  nuifll^'er  of  tliese  stlE^ulus-  i 

^  ***  *^  ■  J 

k'-vi delines  increases  rapidly/  as  the-  formation  of  newer  \ 

^  I 

I  and  newer  reflex  systems  advances  in  fee  aniriia,!.  'Tnls.,  in  | 
kurn  furnishes  a  reouislte  for  the  more  rapid  development  \ 

p  -  '•  -  I 

jof  increasingly  ramified  condltioned-reflax  Bysteme.  There  | 

I  Is  created  a  system  of  processes  which  ara  self“accaieratecl| 
llu  the  process  of  their  own  development.  In  the  formation  | 

I  ■  ■  '  I 

I  of  new  behavior  patterns,  the  survey  of  the  possible  va-  *  | 

^rinnta  ffe,  b.,.  b-,,  ...  b.)  need  now  continue*  not  until  j 

J.  £.  J)  :>  I 

:the  food  appears,  but  up  to  the  appearance  of  any  of  the 
;  conditioning  stlmxili  of  the  reflex  systems  developed  ear- 
llier  (aj^,  a,^,  a.g)  ..  Thus  v.’-e  have  the  explanation  for  one 
It  of  the  characteristic  singularities  of  the  braivi^s  opera.-- 
tlon  as  a  self -organising;  syatemt  this  ccnsistB  in  ul.ie  | 

t 

fact  that  the  capacity  for  further*  learning  lncred.i,-.e&  | 

ranldly  with  learning*  ...  j 

- 

On  analysis  of  the  facts  detected  in  the  Inveatl-*  ■ 
Oration  of  various  routes  to  the  formation  of  condltionecl-  i 

u>  '  .  '  ,  f 

i*eflex  systemSji,  we  may  -eoR®  to  the  concluBion  that  the  [j 
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|algoi*lthiris  iiBed  by  tlr-  brain  also  provide  for  a  definite 
^total  number  of  miles  determining  the  order  and.  nature  o,f 

|tbe  fflove-ments.  In  certain  stages,  of  the  proceoe^  the  cirri- 

i  ■  ■ "  ' 

rmals  carried  cut  only  one  or  two  definite  movements »  .Dur- 

i 

■ing  other  periods,  a  large  number  of  x’andorfi  movements  oc- 

f 

burred,.  The  algorithm  Included  definite  rules  according 

I  to  which  the  moments  of  emergence  and  diBaE>pea.ranoe  of 
i 

U-.he  variant '-survey  phenomenon  ware  datormlnc-d.  The  defin- 

I 

,ite  rule  sum  also  determines  the  nature  of  the  ne;w  motions 
as  functions  of  the  results  of  the  precedlhg  ’^learning*' 
period^  Such  organization  and.  seq,uence  in  the  nature  of 
the  disturbances  that  the  aniir..al  applies  to  the  environ¬ 
ment  is  of  great  &3 gnlficance.  It  reduces  the  number  of 
trials  made  by  the  animal, 

A  general  examination  of  the  desc.r.tption  of  this 
I 

I  algorithm  indicates  that  It  can  ar>parantly^  under  cex^tairi 
conditions,  provide  for  the  development  of  a  new  program 
fof  the  brain's  operation, 

Hovjever,  we  cannot  regard  this  point  as  proven, 

* 

i 

I  Aside  from  the  above,  the  question  remains  open  as  to  the 
conditions  under  which  this  adgorltbiii!  my  prove  effective .j, 
as  does  the  question  of  the  speed  of  formation  of  the  new 
;work  programs,  the  number  of  necessary '  trial s,  and  the  de- 


I 

i; 


I 

f 


Ipendence  of  these  Indices  on  varlcuE 


conditions. 


I 
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t  A  gpeclal  automaton,  was  built  for  study  of  these  f 

I  I 

t  ■  f 

Iqueatlons.  The  automato.n  is  -described  in  the  sixth  chapter  I 
? 

tof  the  pr'ese,nt  book. 

i  \ 

I  Tl'ie  inference  was  drawn  on  the  basis  of  studj/  of  [ 

■  . 

|this  automaton  that  under  certain  conditions,  the  algorl-  [ 

i  ■  ;  t 

Ithms  detected  in  the  an,lmal  experiments  may  lead  to  the  ■ 
i  ■  ; 

|ro.rr!iatlon  of  a  new  program  of  operation  of  the  bralru  •; 

I  '  .  '  ^  I 

I  One  of  the  basic  conditions  necessary  for  the  ef~  i 

i  '  ! 

;fectlve  use  of  an  algoritlun  cons5.stB  in  the  reculrement 
’that  various-  stimuli  that  can  be  sensed  by  the  control  sys-; 

5 

tern  (a.,,  etc.)  appear  from  time  to  time  in  the  ox-  ■ 

] 

terixal  medium,  I 

i 

As  we  have  notadj^  this' condition  may  be  mat  both  j 

i 

in  the  work  of  tte  complex  cybernetic  machinefj;  that  I 

'  1 

control  the  work  of  ind'UBtrlal  enterprises  and  in  study 

f 

of  the  behavior  of  an  animal  un.der  its  natural,  living  con™  1 


[dltions,  I 

Tiie  appearance  o.f  various  stimuli  in  the  environ-  \ 

1 

merit  may  be  cau.B€d  by  the  'unfolding  in  this  medium  of  va-  [ 

.1 

r.lous.  procesaesj  the  result  is  that  all  possible  varlatlonsf 

} 

will  arise*  Tliey  may  also  be  due.  to  the  movements  of  the  | 
animal  or  to  activities  of  the  cybernetic  machine  that  give! 
rise  to  certain  changes  in  the  Eurrormdlng  situation.  I 

I  Thus  the  algorithm  described,  may  be  embodied  in  I 


no 


ithe  technical  control  Bystems  ■with  which  the  operation  I 


I  —  ■ 

Inf  ijiduEtrlal  enterpriaOB  ia  controlled  and  also  Berve  as  , 

I  '  ‘  i 

la  hasis  for  the  development  of  new  coiiiplex  'behavior  pat- 
I  ' 

Items  under  the  natural  life  conditions  of  animal e-.  The  | 
1  ’ 

feffecttveneES  of  application  of  this  algorithm  depends  on  I 


la  whole  series  of  factors: 


I  1)  the  probability  of  the  appearance  of  the  varlo-usj 

\.  I 

i  stimuli  in  the  environment  and  the  duration  of  the  time  | 

I  ■  \ 

(for  which  'chese  stimuli  act;  | 

I  2)  the  speed  of  the  control  system  *0  reactioTi; 

I  3)  the  total  number  of  motor  reactions. of  which 

I  the  control  system  Is  capable  and  the  total  number  of  : 

i  •  •  ■ 

I  '  ' 

} Stimuli  that  it  can  pick  up  from  the  external  medium^  i 

I  Let  us  consider  a  certain  concrete  situation  in 

order  to  analyse  the  speed  of  development  of  a  condltio.ned- 

I  reflex  chain  under  different  conditions, 

I 

I  Let  the  control  system  "A”  have  n  different  re- 

feeptors  capable  of  penning,  various  stimuli,,  end  be  capable 
I  of  performing  m  different  activities.  At  the  same  time.,  ■  i 

I  I 

.  f 

varioiis  stimuli  iu8.y  arise  at  randowj,  with  a  certain  proba-  I 

■  I 

billty  Pj  In  the  external  medluai.  fca'rrounciing  tbs  control  | 
system,  I 

i  '  •  I 

Let  UB  sunpose  that  each  of  the  stimuli  can  arise  I 

1 

flO  times  in  the  course  of  an  hour  and  that  Its  action  is  | 


■terminated  after  teii  seconds*  It  Ib  necessary  to  develop 


fthe  reflex  chain  ___ 

I  a.  ■  _ 


a..,  b-. 

o  —  d 


food, 


i  For  the  fii'‘st  conditioned  reflex  to  be  developed, 

lunder'  these  conditions  it  is  necessary  that  the  • 

i 

^  **  coinc.lde-  several  tinies  wit.h  the  aniffisl'^s  n].ovt:Tfle.iit  ;. 

this  would  result  In  the  acquisition  of  food*  > 

!  General  examination  of  the  conditions  of  operation  ■ 

n-^o  the  system  indicates  that  the  probability  of  this  coin-  i 
icldence  is  not^  in  itself ,  very  high.  Tiius  the  first  sta~  | 
jges  of  development  of  tlie  reflex  chain  will  proceed  very  j 
Islewly*  However,  an  important  singularity  o.f  the  algorithm  | 

I  "  '  I 

I  described  is  that  t.he  process  of  development  proceeds  with  | 

I  '  '  t 

1  increasing  rapidity  as  new  conditioned  reflexes  are  formed 
I  If  the  animal  has  already  formed  certain  condi-  •  j 

It'one-d  x’'efle.xeB  and  aj.  and  a-  are  the  oonditionlng  stimuli'; 

I  of  these  reactl-ons,,  coincidence  of  the  stinuiliis  ap  Wj.th  : 

; food  will  not  be  necessary  for  development  of  the  next  | 

i  I 

\  conditlonca-reflex  reaction.  The  development  may  occur  | 

[  ,  I 

I  on  ^’oincldence  of  new  stlBiuli  with  the  signal  with 

I  ■  ‘  .1 

I  the  signal  a-,  etc*  Thus  the  probability  of  the  coanci-  | 
i  donee  necciSSary  for  the  construction  o.t  the  nevx  reflex  j 

I 

1  reaction  increases  significantly.  Here,  the  greater  the  f 

'  .  *  i 

I  miraber  of  conditioned  reflexes  developed,  the  hlgn&r  wixl  | 

ibe  the  probability  of  eo-occurrenoe  of  the  two  stimuli  | 
j  cevelopirig  new  conditioned  reflexes.  Thus  we  haye_a.j:u-^,c?^j 
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- .  - _  ''''  i 

I  .'I  i  II  iM-  rwiiMi  i.iwwi  l■■ll■l^  f 

I-Jhiah  goas  faster  and  faster  as  It  unfolds,  W,  Ross  Ashby  f 
/59j  60/  Indicated  the  importance  of  studying  such  proce*^-  f 
}ses.  He  stressed  that  the  detection  of  processes  of  this 

I  •  ■  1 

jtype  in  biological  systems  may  result  in  solution  of  a  [ 

i 

jserles  of  vital  physiological  problems, 

I  In  addition  to  the  algorithja  described  above,, 

I  .  *  vr 

s 

pertain  other  algorithms  were  detected  which  may  also 
» 

play  major  roles  in  the  formation  of  the  condltiont^'d-re- 
flex  chain. 

One  of  these  algorithms  may  be  describM  as  fol¬ 
lows  (algorithm  No.  2) :  , 

,  In  the  development  of  the  clialn  b,  a-,  b,..  a. 

_  food 

1.  The  aninml  performs  random  activities  (b^  ... 

jb  ),  In  the  event  tl'ia.t  some  movement  (e.g,.  b-O  coincides 

1  . 

several  timas  with  food,,  this  movement  is  memorized.  Then 
the  following  changes  in  the  animal’s  behavior  are 
observed?  a)  the  random  movements  ceases  b)  the  animal  be¬ 
gins  to  perform  the  motion  b^  continually. 

2,  If  the  animal  now  receives  food  each  time,  no 
further  changes  are  observed  In  its  behavior ,  If  the  ani¬ 
mal  does  not  get  food  after  performing  the  movement  b^., 

jthe  movement  b^  disappears.  Together  x-^ith  this  we  observe 
a  i-eaotlon  associated  with  the  appearance  of  numerous  ran- 
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fCiom  ms>re®eJits*  ■  '  '  ■':  I 

f  ,  ■  _  '  f 

j  3,  If  none  of  the  random  mo vei»ents  h^.*  ^4^^  '^qj*  ■ 

jete,  j>rod.«c©is  a  ohange  i.n  the  siirroundlng  medivaa^  these  .  ^ 

Imoyements  are  given  up«  If  some  one  of  the  mov'Siaents,.,  e.S.f| 

|tv»>  :j;‘GBylts  in  tlia  appearance  of  some  completaXy  neif?  (food-, 

I -unrelated)  stinralus  an  orientation  reaction  appears^  ^ 

^Thls  reaction  is  BianifeEted  in  the  animlls  first  perform-  | 
i  ■  '  ■  ^  .  I 

I  Ing  "the  previously  abandoned  moveirsent  b^«  I 

\  Bhotald  food  appear  as  a  .re>3nlt  of  this  movement,.^ 

I  ,  ■  ■ 

I  then  the  inotion  bv,  that  prodviced  the  nev*  stimuluB  | 

I  '  i* 

I  well  as  the  stlmulua  gp  itself  are  mamorlzed.,  j 

I  5.  The  following  changes  in  the  anixriHl^s  behavior  I 

I  '  I 

fare  then  observed j  the  random  movement b  cease ;  the  anlny?,!  .  , 


I  "'2^  ' 


I  bo  gins  to  perform  the?  moveraent  bp  continually;  This  move-  | 

I  ment  results  in  the  appearance  of  the  t^timulus  a^,,  fhe  | 

I  gtlmulus  B,,s  produces  the  movement  and  the  acquisition  | 

f  •  ^  ^  ft 

\  I 

f of  food.  I 

i  I 

I  6.  Thus  two-  links  of  the  reflex  chain  are  found  j 

[to  have  been  formed  at  once*  New  movements  are  developed  | 

and  new  conditioning  stimuli  are  cut  into  the  system  at  j 

I 

tliO  E5aie  t5jfle.  ■  '  '  I 

I  7,  If  this  chain  of  reflexes  Ictads  to  foodj,  no  | 

I  '  '  '  'I 

|f'arther  changes  are  observed*  If  it  does  not  lead  to  food,  | 

I  the  animal  begins  to  carry  out  random  movements*  I 


«t!uOKS6 


f  .  8.  I.f  an  ent-irely  new  stimulus  arises  as  a  result 

[of  some  movementj!,  the  animal  respond«s ■  to  this  etlirtuluB 


|wltli  the  movement  bg  which  it  had  previously  abandoned^ 

|The  further  formation  of  a  complex  chain  of  conditioned 

f 

'reflexes  may  proceed  on  this  principle » 

I  Let  UB  also  present  an  operating  algorithm  (algo- 

irlthin  No.  3)  based  on  orientational -exjiloratory  activity. 
I  The  chain  of  reflexes  a. 


a 


b-j  S/- 
i  —  eL 


bg 


0 


b. 

o 


food 


jls  developed* 
i 

I  1,  Tbs  animal  performs  random  movement b  (b.,  jb^,,* 


jb)  and  variant  sets  of  movements  (bg,*  b^^  b^^  bj^/ 
b^.,  etc.). 

I  2.  If  no  chaitges  occur  In  the  environment  as  a 


b. 


L. 


result  of  these  movements^  and  new  signals  ag^  ...  j 

®“j^)  not  appear j  the  testing  movements  are  diccontimj.ed,  | 
Kotor  activity/  disappears  altogether  after  a  certain  peri 
!of  time. 

3.  If>  however,  some  completely  new  Indlffcjrcnt 

jElgnal  (a^.  Eg.  ...  a^)  not  related  to  food  arises  as  a 

jregult  of  these  motions,  then  the  motions  that  disappeared 

ieax\ller  (b, ,  b^,  b.,  b„ )  reappear* 

1  J.  n 

I  In  addition,  the  motions  that  produced  the  new 

fslgnal  are  remeiribered. 

4*  Thus  a  cha,ln  of  reflexes  is  formed  on  the 
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Inovelty  principle  -until  this  reflex,  chain  accident  all  3?' 
(results  3-n  the  appearance  of  either  food  or  one  of  the 

r 

bondltloning  atlmult  of  the  notirishnient  reflex  Bystess 

I  * 

(developed  earlier.  Then  the  entire  Bj^etem  worked  out  on 
rthe  Das3^s  of  novelty  reinfor'ceEient  is  stahillsed,, 

s 

I  This  ineihod  of  development  has  3.aportant  short- 

[comings.  The  animals  iis-ually  develop  a  reflex  chain  oon- 
jtai.ning  very  many  extraneous  components  rather  than  the 
[chain  _  ag  _  bg  _  b^  food.  For  example  j 


P'l  ~~  '*^10 


bn  b 


a^  bobi,a^a..bi,bi.  food. 
p  —  2  -r-  2  4  0  3  4  -'+  -- 


A  .special  slgorlttars  is  used'  to,  bring  this  system 
i..nto  correspondence  with  reality. 

The  animal  begins  to  eliminate  various  motions 
from,  the  systera  one  after  another.  For  examplej.  lb  fol¬ 
lows  not  the  chain  _  '^■’l0^15'^’' '*^6  ^2  —  ^2^*4  ~  — 

bj^b-j^  __  food,  but  the  chain  „  9^2  — 

V3-  ■  . 

.  1.  If  this  shortened  chain  is  reinforced  by  food^ 

the  dropped  link  (b^c^b^bg)  is  not  restored. 

2,  If  food  is  not  forthcoming,  they  reappear  ne,xt 
time  and  another  element  of  the  chain  Is  dropped.  Thus 
all  elements  of  the  system  .are  tested,  one  after  another, 
Ito  see  if  they  are  essential,,  and  the  extraneous  ones  are 
gradually  "sifted  out,"'  In  the  end,  only  the  necessary 
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tehatn  &,  b.  food  remlns, 

I  1  —  JL  —  £1  —  ^  —  3  — 

f  ■  .  • 

j  Tile  abore  algorifeban  No.  3»  yfnlch  In  based  on 

lorlentational -exploratory  activity,  may  be  reed  under  con- 
tiltioniS  in  >jhich  algorlthiR  No,  1  would  be  Ineffective, 
since  it  does  not  require  the  appearance  of  new  s3, gpiais, 
The  aninal  Itself  gives  rise  to  the  appearance  of  these 
HlgnalG  through  its  active  movenwints..  This  algorithm  has 

\ 

ieBBentlal  deficiencies,  however.  These  consist  in  tne  fact 
that  it  does  not  provide  an  adequate  systein  for  evaluating 
the  usefulness  of  the  inforsiation  entering  the  brain.  The 


inovelty  of  the  Incoming  information  is  the  reinforcing  , 
^factor  that  provides  for  the  development  of  new  conditioned; 
-reflex  chains.  As  a  result,  the  algorithm  may  lead  to  the  ' 
development  of  a  very  large  number  of  unnecessary  reflex  ! 
aystems,  This  property  of  the  '  algor ithi^i  determines  the 
circumstance  that  It  can  be  used  only  by  Bystems  that 
have  considerable  storage  capacity.  For  example,  it  Is 
xu»e.sent  in  dogs  and  absent  in  pigeons,  and  used  only  .to  a 
small  extent  by  rats. 

Under  tholr  natural  living  conditions,  animals 


apparontly  use  different  algorithms  in  different  cases,  | 

The  simultaneous  complex  use  of  several  algorlthmE  in  | 

■  1 

''Btudvirsg”  a  new  situation  la  evidently  most  rational .  | 

:  ^  -  ,  -I 

fpor  example,  in  the  case  of  complex  application  of  algo-  I 


.fj 
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r-Tt 


|rlthms  No.  1  and  3^  the  animals  may  use  algorithm  No. 

1 1  to  create  a  system  for  evaluation  of  the  usefulness  of  J 
I 

[bits  of  inforrsiE.tlon^  and  then  employ  algorltlmi.  No.  3  to 
f 

I  begin  an  active  "investigation”  of  external  laws.  In  tJila  i 

\  '  '  I 

i case  the  process  of  "inveEtlgation”  wil3  doubtless  prove  J 

I  more  fruitful ,  since  It  can  culrrdnate  not  only  In  the  ap- 

i  ■ ' 

1  pearance  of  food  (an  tinconditioned  .stlmuHus but  also  on  * 

j  '  ? 

! the  appearance  of  any  of  the  signals  developed  on  the  \ 

I  “  \ 

I  basis  of  algorithm  No.  1  (the  latter  serve  as  guide-1  in-SB ) .  I 

This  consldex*atlon  of  the  progress  raises  the  ne-w  | 

question  as  to  the  existence  of  a  system  of  rules  ialgo*-  | 


ritlmhs)  of  even  hlghei*  order  v’hieh  determines  the  optimal  I 


I 


seriuence  of  application  of  algorithms  No,  1,5  2,  and 

The  animal  apparently  first  develops  a  certain '  | 

I 

"rnost  conven5.ent”  program  for  U-Slng  the  various  algorithms  | 

on  the  basis  of  certain  general  features  of  the  new  situ-  s 

I 

iatjon:  the  'orocess  of  "investigating”  the  new  environment  1 

"  ■  ^  ■  .  I 

is  effected  thorough  following  this  program.  The  question  j 
of  the  nature  of  these  highar-order  algorithms  is  highly  \ 
important  and  should  become  the  object  of  special  Inves-  J 
tigatlons .  \ 

I 

d)  More  Complex  Forms  of  Information  Processing 

In  the  preceding  chapter  vm  analyzed  the  laws  of  I- 
operation  of  the  brain  which  are  related  to  the  formation  I 


I 
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I  of  conditioned-reflex  chains.  However,  the  simple  reflex  I 

I  chain  is  only  one  of  the  simplest  forms  of  activity  of  I 
the  brain. 

I  •  .  ..  ■  ; 

I  Tinder  the  natural  living  -conditions  of  animals/  | 

I  they  exhibit  forins  of  behavior  based  on  a  considerably 
I  more  complex  conditioned-reflex  Eystem  which  Integrates  | 

I  a  large  nmaber  of  singularly  Interrelated  simple  condi--  | 

I  tioned-reflex  chains.  Here  the  executj.on  of  the  Individ-  I 

I 

I  ual  reflex  chains  which  form  the  overall  system  does  not  I 
i  '  '  '  .  .  '  'I 

I  usually  lead  to  the  acquisition  of  food,  but  mei^ely  I 

I  creates  certain  "pre-requisites"  which  make  it  possible  | 

for  other  conditioned-reflex  chains  to  result  In  the  | 

satisfaction  of  this  need  Wider  certain  condi tlons  in  the  | 

future*  Here  the  final  reinforcement  by  an  laiconclitioned  |  ' 

stimulus  in  the  form,  of  the  acquisition  of  water  end  food  j 

may  be  put  off  by  a  very  considerable  interval  of  time.  1 

I 

For  exe.inple,  to  obtain  food  under  the  natw^al  conditions  | 
of  its  existence,  a  carnivore  must  track  prey,  catch  it,  j 
and  kill  It,  and  only,  then  1b  the  direct  unconditioned 
;  reinforcement  achieved, 

'  I 

■  ■ 

Thus  in  the  natwal  living  conditions  of  the  | 

f 

animal  we  encounter  the  existence  of  so-called  polyphase  j 
behavior,  in  which  each  of  its  stages  creates  only  a  ■  | 

"pre-requlBlte"  for  the  execution  of  the  following  phases  I 
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of  the  be  ha  vies?,  I 

Study  of  the  algorlthwis  that  -fom  a  basis  fo^r  the 

development  of  these  -eomplex  behavior  patterns  pro gents 

conElder&ble  interest*  ^ 

I  As  we  have  already  noted^  it  is  necessary  in  con-»  ; 

*■ 

i  .  p 

?  sidering  this  probleui  to  take  into  account  tlie  iiiteraccion  .1 

I'  •  ^ 

i  ■  '  ij 

I  between  two  Interrelated  systems^  ■  | 

I  One  of  these  systems  is  the  coiitrol  system  ( brain )jJ 

land  the  other  systeffi  is  the  external  wediuin  or  "the  field  i 
>  of  activity  of  the  control  systera”*  Complex  systeis.®  ox  | 

I  ^ 

f  terrelated  processes  obta5.n  in  the  external  medium*  ■  | 

1  ■  In  our  examination  of  the  problem  formulated  in  th«| 

{  .  I 

j  present  chapter^  we  shall  tak:e  into  account  the  existence >  | 

I  In  the  environment of  Bystems  of  relatlonshiI>s  which  are 

I  mors  coa^plex  than  those  considered  in  the  preceding  chapter. 

i 

i  Inclucl&d  araong  the  general  cases  is  the  case  in 

i, 

'  w}f  ch  the  presence  of  some  factor  Inhibits  the  completion  | 

1-  "  ”  ..  I 

I  of  a  given  process.  As  an  example,  we  might  mention  the ^  s 

I 

I  case  in  which  the  presence  of  soma  substance  in  the  opera.-; 

i  ■  .  1 

I  tion  of  a  chemical  enterprise  operates  as  an  obstacle  to  | 

j  the  uifolding  of  an  entire  cycle  of ' chemical  reaction*  In  j 

1  this  oase^  the  problem  of  study  of  thoae  algorithms  in  thi 
I  -  I 

I  control  B.yBtem  which  would  make  it  pos.aible  to  determine  | 

I  which  substance  is  interfering  with  the  process  and  I 
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■kil'f.cb  would  work  out  a  new  operating  program  leading  to  the  | 
'Jliinlnation  of  thlB  detrimental  product  acquires  great  nig,-  | 

:  T if 1 canoe.  •  1 

i  The  case  in  which  the  presence  of  two  mutually  in-  I 

i  [ 
jdependent  components  is  found  neceasary  for  the  accoirinlleh"- 

I  '  '  '  '  ■  ! 

giexit  of  a  pioocess  may  serve  as  another  general  case.  In  this 

I  ( 

feasc  we  encouiiter  the  probleiii  of  find iing  operating  algo-  i 

{  '  I 

|nlthns  for  the  control  Bystem  which  would  make  it  possible  | 

ii  I 

ito  j.dentify  each  of,  the  neceSBary  ecmponentB,^  | 

f  i 

I  The  conrolexity  of  this  problaTs  consietB  in  the  faxti 

I 

n 

!that  the  expediency  and  importance  of  one  of  the  coiiriponents.] 
|may  become  evident  only  in  the  presence  of  the  second  com-  I 


poncnt.  The  result  Is  that  evaluation  of  the  value  of  the  | 

j'  • 

individual  components  becomes  difficult,  ; 

i 

The  algorithm  should,  in  addition,  provide  for  the  | 

I 

Idevelopment  of  now  operating  programs  which  could  provide  i 

■  ^ 

for  the  acquisition  of  each  of  these  components  independe.n.tl,y 

i 

f  1 

|of  the  ctlier.  Here  It  is  Important  to  note  that  In  contraBt| 

!« 
to  the  case  of  development'  of  simple  reflex  chains  analyzed* 

t  .  - 

'above,  the  ardmal  will  not  obtain  confircnation  in  the  form.  * 

i 

|of  food  in  developing  newr  behavior  patterns  in  this  case,  \ 

i  i  ■ 

fslnce  the  presence  of  ore  of  the  components  is  still  lnEuf-| 

Ificlent  for  the  appearance  of  an 'unconditioned  confirmation.! 
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I  It  must  be  noted  that  we  ane  conslderlrig  a  definite 

I'^i^lnolple  of  the  struct-are  ofsystema  of  external  laws.  The 
Lxternal  relatione^hips  themselves  may  definitely  be  much  ■ 
|:,ior'e  complex  In  forrfij  as  an  example>  the  system  of  laws 

s 

igoverning  the  operation  of  a  chemical  enterprise  ma,y  Includ*, 

V 

jsystems  of  eause-and'^effect  relationships  in  which  both  of  . 

;the  principles  described  above  (the '  principle  of  the  rjreS'- 

(ence  of  a  substance  which  interferes  with  uhe  reaction  and 
S' 

i 

I  the  principle  of  the  presence  of  two-  components)  may  appear. 

repeatedly^  combining  with  one  another  in  &  complex  manner* 

Study  of  the  principles  on  which  a  control  system  ) 

lp'le,fled  under  the  conditions  described  above  can  ■work  out  > 

I  optimal  belmvior  patterns  •which  take  into  account  all  prop-. 

[ertles  of  the  complex  laws  of  its  external  surroundings  is  : 

( 

of  interest.  '  i 

•  ! 

i  Me  have  already  noted  that  the  development  of  a  [ 

!  f 

I  simple  oondltloned-reflex  chain  rasy  be  re.garded  a,s  a  pro-  | 

f.  '  .  \ 

\c&BS  of  detection  of  systems  of  external  laws  prevailing  i^ 

I  I 

I 

the  environmen'fc  and  construction  of  an  Isomorphic  system  j; 

constituting,  as  It.were^  a  ''copy”  of  the  prevailing  sys-  j 

J 

Item  of  external  relationships  on  this  basis  in  the  brain.  5 

I  ^ 

t  The  problem  presented' in  this  chapter  may  be  for-  : 

I  '  ■  i 

|rriula.ted..  a'S  a  problem  of  finding  algor ithm.s  which  -will  pro4 
Ivide  for  tlie  formation 'of  more  complex  isomorphic  systems  | 


McSKStmi 
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I 

i 

\ 


- —  --(t--r  rr-fTT •  m.rrniii~''fi];--^‘r.'iBor'Tr[ 

that  a?-e  oa-nable  of  inflecting  more  complex  forms  of  Inter-  I 

I  ^  -■■■.’  I 

px'tion  of  the  syBtems  of  external  lawsi  In  their  work* 

The  formul  ation  of 'tlie  prohlam  given  above  Is  In  ^ 
jj-juoti  agreexiient  with  Ashby's  system  ox  concepts »  He  vj cites  I 
1/59/  that  'Vyhernetlca  Is  essentially  concerned  with  study  | 

f  '  '  '  1 

|of  cause- and“-ef feet  relationships,  particularly  in  cases  ' 

I  .  ^ 

Ivjhen  they  are  represented  by  long  chains  of  eventa  in  vihich| 

i  ^  i 

juhe  activity  of  each  stage  serves  in  turn  as  the  cause*-  ol  j 

i 

the  following  stage.  In  such  cases  vsa  study  the  relation  no|; 

'  ■  '  I 

'of  ona  cause  to  one  effect  hut  thiit  of  the  whole  group  of  | 

I 

causes  to  the  group  of  effects  that  corresponds  to  them,  | 
Blnce  the  rclati-on  of  causa  to  effect  is  most  clearly  oh-  | 

'  '  •  I 

served  j.n  mechanisKiS  of  various  types.,  the  technique  of  cy-j 
hernetics  is  readily  applied  to  them.  | 

Thus  cybarneticr.  is  a  part  of  the  general  science 
of  dynamic  organ! !3atlpn’^v 

We  have  discussed  the  question  of  the  relationship 
of  cybarnetlcB  to  T.I.  T^enin's  reflection  doctrine  in -a 
special  article  /36/, 

Special  e:cp>€riments  were  carried  out  to  study  the 
problems  formulated  above.  The  te-a-teique  of  these  experi¬ 
ments  was  similar  In  principle  to  the  technique  used  for 
study  of  the  laws  of  development  of  simple  conditioned  re¬ 
flex  chains.  The  dlffsirence  consists  in  the  fa,ct  that  more 


iplex  systems  of  external  relationships  (lnterrelationEhii:|i 


between  different  signals)  vrere  created,  during  the  experi-  ■ 

faent  In  the  external  medium  surrounding  the  animal.,  Specifi-| 

i  -  '  ■■  ] 

feallyj,  systeffiB  of  laws  were  created  in  which  the  presence  of 

V  f 

bne  stimulus  made  it  impossible  to  carry  out  an  entire  chain 
■’  '  ^ 

iof  nourlEliment  conditioned  reflexes  that  had  been  developed  > 

> 

rprevlouBly,  ? 

V  i 

i  Under  these  conditions,  .Just  as  in  the  deyelopme.nt  f 

f  ^ 

jof  simnle  chains  of  conditioned  reflexes,  we  cbs€i.rved  a  •? 

Ipi’ocesB  of  gradual  formation  of  complex  condltloii€'d"refle.x  | 

js';; stems  which  reflected,  oo.rr'ectly  the  systame  of  external  j 

i  ^ ,  I 

[l.aw'g  created  artificially  In  the  course  of  the  experlm.ent^  I 

f 

jand.  which  made  It  possible  for  the  animal  to  obtain  food  | 

1  '  * 

|i.inder  these  conditions „  | 

I  The  following  important  facts  were  observed;  It  was- 

I  .  .  ! 

i  found,  that  the  animal  w£is  capable  of  identifying  stimuli  j 

^  "  i 

d  the  execution  of  a  conditloned-'-refle.x  ohalrj^' 


S which  prevente 


land  also  of  identifying  stlaruli  in  cases  when  the  slmul--  j 

I  .1 

I taneous  presence  of  several  different  signals  was  necessary! 

I  \ 

I  tor  the  acquisition  of  food,.  j 

i  ■  i 

I  The  fact  that  new  conditioned-reflex  rei^,ction  chains 

I  ■  ! 

[can  be  worked  out  by  the  use  of  the  disappearance  of  the  I 

f  •  I 

IstjmuluB  v^rhlch  Inhibits  the  completion  of  the  nourlshrflent 

I  I 

i.reflex  e.hain  as  a  reinforcing  factor  is  an  important  cir- 
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bviKistancs,  ^i'hese  chains  of  cohdltlcned  reflesr.es  are  dis-  f 
I  F 
I  j 

tinguished  by  the  fact  that  they  do  not  reqvrire  rolnforcs-  ■ 


|mcnt  by  an  unconditioned  etimulus  (food). for  their  develops : 
jment,  but  are  reinforced  by  the  dleappearance  of  the  stiirm-i 
jlue  which  prevented  the  completion  of  the  nourishment  chain | 


of  reflexes  ] 

e 

To  use  physiological  te^^j^lnology,  this  stl.muluB '  may 

be  referred  to  as  an  inhibitory  conditioned  stimulus  and  thli- 

chain  of  .reflcxen  based,  on  it  may  be  regarded  as  a  ’’dein-  ; 

hlbltlng  chain”  of  conditioned  i'>eflexe&*  -I 

!» 

This  chain  of  reflexes  ie  Included  In'  the  general  | 

icomplex  of  the  nffurlshment  reflex  system  as  one  of  Ite  com-J 

I  .  '  '  I 

|pcnent&,  and  it  vanisheSj  for  example,  when  the  animal  is 

i  - 

I  satiated  or  when  the  nourishment  reflex  sys-tem  :ls  not  sus- 

I  tained  by  food.,  At  the  sarae  time,  it  posseBses  a  certEln  de- 
f  .» 

|gree  of  "autonoiKiy”,  since  it  can  ha  separated  .from  the  basilc 

f  1 

inourlEhment  chain  by  a  considerable  Intei’val  of  time  and  ( 

I  I 

tdoea  not  .have  to  be  followed  by  reinforcement  of  food, 

i  -  I 

\  The  food  (the  unconditioned  I’einforcement)  is  pro-  | 

}  f 

ivided  after  completion  of  the  entire  conditioned-reflex  | 

\  ■  .  ■  i 

I  system  in  v<hiGh  this  ’’da inhibiting  chain”  occurjei*  I 

\  •  '  I 

I  'life  detected  certain  lav/c  rels,te.d  to  the  achieve-  j 

i‘  lit 

pent  of  deinhlbltlng  reflex  chains.  It  was  foimd  that  ani-^  I 
Imals  react  to  conditioned  stimuli  of  deinhlbltlng;  x-eflex  I 
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IzhainB  only  vehen  the  InhiMtcpy  conditioned  Btliivalxm  on  '  | 

fhlch  the  conditioned  reflex  chain  in  question  was  dsvelopei^ 

0B  applied,,  If  the  Inhibitory  conditioned  stlmxlns  was  . 

f  I 

jcut  outj  the  animal  did  not  react  to  the  conditioned  signalo  j 

the  deinhlbiting  reflex  chain  even  though  thi0  chain  had[ 

I  . 

Ibeen  fully  stabilized,  ; 

i  ■  Thi’S  we  arrive  at  the  concluiion  that  the  Edcructxire , 

;  ■'  ^  I 

of  a  conditioned-reflex  system  can  not  be  reduced  to  a.  eim-i 

I 

pie  chain  of  pucceB£5ive  conditioned-reflex,  reactions*  Sys-  | 

'  ■  I 

teffiE  exist  with, a  definite  more  complex  stricture  whicn  is  i 

I 

related  to  the  presemce  of  a  stimulus  which  we  shall  call  | 
the  **swltching-in"  stiHulu.s*  Although  this  stimulus  •  does  | 

I 

not  give  rise  to  any  specific  motor  reaction^  it  doss  set'  | 
the  entire  chain  of  conditioned  reflexes  into  operation*  | 

I 

¥e  have  already  mentioned  that  certain  princlpxes  \ 
‘■of  the  structure  of  conditioned*®  re  flex  eysteiriB  came  to  f, 

I  '  ■  ! 

flight  in  our  experiments*  In  actuality^,  the  systems  which  | 

I  exist  under  the  natural  living  conditions  of  the  animals  | 

and  ax-^e  constJ’uoted  on  the  basis  of  these  principles  my  I 

tJoemselves  be  highly  complex,  Oxu*  experimentB  showed  that  | 

I 

the  inhibiting  reflex  chain  may  develop  its  own  "condltionei; 
Inhibition”  on  the  basis  of  whose  application  an.  inhibit- 

I 

ling  second-category  conditioned-reflex  chain  may  be  de-  | 
Iveloped*  This  second  inhibiting  chain  of  reflexes  ziiay  also  I 
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6  _ * 

develop  its  "own”  conditioned  Inhibition^  the  neinoval  of  I 

I 

which  may  serve  ae  a,  baBls  for  the  de-t/eiopment  of  a  third 

inhibiting  chain,  ■  ; 

I  In  study  of  this  complex  system^  which  consists  of  | 

i  several  chains  of  conditioned  reflexes,  we  may  detect  the  j 


i presence  of  a  whole  complex  of  "reciprocally 
i conditioned  stimuli  which  trigger  one  another 

3 

j  ■  ‘ 

I  Let  us  present  a  schene. 


subordinated"  ( 
? 

1 

4 


I  Id.  this  diagram,,  the  conditioned  switch J.ng“in  0tim| 

I  ull  are  denoted  by  the  different  letters  '^^3*  | 

I  The  experiment  indicated  tliat  tlie  execution  of  bhe| 

i  [ 

I  third  Inhibitory  I’cflex  chain  is  poSElble  only  in  the  pre»-j 

I  sence  of  the  tlu-ee  triggering  conditioned  stimuli  t  '^2‘M 


I  and 

The  triggering  of  the  second  inhibitory  chain  is 
I  possible  in  the  propcince  of  the  two  and  only  the  tw'O  trig'* 

I  gex»lng  stimuill  and 

i  ¥e  may-j,  on  the  basis  of  the  experiment  draw  the 

1  following  conolualonE  concerning  the  algorithms  of  inform^ 


ation  processing  in  the  brain  which  provide  for  the  forma-" 


tlon  of  more  complex  conditioned  reflex  BysteilE.. 
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I  Upon  performance  of  algorithm  number  one,  •which  -we  | 

(,  ■  _  ■  ■  ,  ■  ? 

Idescribed  earlier  as  leading  to  the  de-velopment  of  the  f 

t  .  .  ■  ^' 

Inourlstinient  reflex  chain  (a^-b- •“-ag-'bg'-food)  the  follovifing  . 
Ireauence  of  activities  (algorithm  No.  4)  IS  carried  out:  j 

I  ~  '  .  '  •  ■  'I 

i  1*  If  the  chain  of  reflexes  leads  to  the  aequisl-  ! 

I  tlo'c  of  food  in  each  caBo^  then  no  further  changes  are  Briade' 

t  '  i 

t  ■  ■  ■■  ? 

!. in  the  s'ystem  of  activities*  ■  t 

1  2,  If  the  chain  developed  does  not  lead  to  the  ac-  f 

I  ■  ■  ■ 

Iquisition  of  food  each  time,  the  animal  begins  to  sense  ex*j 

I  ternal  stimuli.  Now.  if  the  presence  of  some  stimulus,  (for  , 

I  example  'T-,  )  coincides  se'veral  tlmies  with  the  performance  j 

i 

of  tlie  chain  of  reflexes  a^-b^-Sg-bg  and  T*?ith  the  absence  | 

:i 

of  food,  then  this  stimulus  Is  remembered.  i 

i 

3*  After  this,  the  following  changes  appear  In  the f 

I 

b€*havior  of  the  an:Imal  t  i 

!  ^ 

\  a)  during  the  period  in  whi-ch  the  stimulus  is  | 

I  *  I 

IpreBent,  the  anlml  does  not  respond  to  the  conditioned  j 
signals  of  the  previously  developed  chain  of  nourishment  | 
reflexes  (a-,,ap)ji  j 

J.  c  _  ■  .{ 

b)  the  animal  reacts  to  these  signals  dur-l 

ing  the  period  in  'which  this  sttm-ulus  (T^)  is  absent.  j 

4.  If  the  stlm’dlus  occurs  seldom  and'  acts  for 
bnslOTif leant  periods  of  time,  no  further  changes  are  ob-  ; 

I  '  ■  '  ■ 

I  served  in  the  behavior  of  the  animal.  ,  ^ 

»  £ 
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i  If  the  BtirmiluB  arlaes  fx*eque;itly  and  aets-for  ,a| 

[  '  '  '  ^ 

[long  period,  of  tlrriej  a  large  n-um’oer  .of  random  motor  reac .  i 

itione  arise.  If  one  of  these  motor  raaetlonE,  for  exarnjle  bi,, 
I  coincides  sevara],  times  -with  the  dlsappear.ance  of  the  stlr!i-|’ 
lulus  T- ,  this  reaction  Is  jaerrembfersd »  ■ 

t  a'  ■.  I 

I  ^5.  Thereafter  the  follo^Jing  changes  In  the  behavior 

i  •  ; 

i  of  the  animal  are  ohserveli  the  anlTKil  ceases  all  random  j 

i  ■  f 

?  motions ,  The  motion  b),  v?hich  coincided  several  times  with  | 

}  ■  ^  t 

i 

!  the  dleappearanco  of  the  stimulus  is  reinforced  and  re-  | 

i  ■  i 

>  pea. ted  each  time  tlie  stimtuus  T^  appeals,  ,,i 

I  « 

I  Then  algorithm  No,  1,  which  provides  for  the  de-  | 

!  •  "  I 

l.velooment  of  a  reflex  chain  leading  to  the  diEapj'.'ea,ranc,e 


of  the  stimulus  T, ,  is  applied .  I 

f  I 

i  In  another  series  of  exneriments^  we  created  an' ex-f 

i  '  '  1 

I  tcrnal  situation  In  -wliich  the  appearance  of  food  became  | 

I  possible  only  in  the  Bimultaneous  presence  of  two  mutually | 

r  I 

t  independent  stimuli,  IfCt  us  present  a  schematic  rex)rasentaf 

I  ^ 

f  cion  of  this  situation.  .* 


I  The  acquisition  of  food  was -posBible  only  in  the 

J 

j  siirru,ltaneou3  presence  of  the  stimuli  and,  ag.  F’ood  v?aE 

I  • 

I  not  given  to  the  animal  in  the  presence  of  on®  of  these 

1  atimull  alone.  When  'the  animal  was  placed  under  these  con- 
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I  <31  tions.  it  was  observed  that  It  developed  a  reflex  response^ 

I  ^ 

[  to  a  complex  stimulus  which  Included  the  two :  corriponents  j 

r 

and  Tlie  reaction  was  not  executed  In  the  absence  of  one 
i 

i of  the  component E,  ; 

i  .  .  ' 

i  It  Is  Important  to  note  the  fact  that  the  cutting  ? 

I  in  of  one  of  the  components  of  the  complex  stimulus  (e.^  or 

I  .  ' 

|a,c}  can  serve  a,s  a  support  for  the  development  of  a  new  ; 

»  ' 

•  f 

i  chain  of  reflexes  f  a.  *-0-, --av3“b^,“a.-s  or  a,-, -l)i, -“a^‘“br-~a.') «  Just  I 

;  •  J.  ^  cl  J5  ^  0  0  .  I 

r  as  v;as  the  case  In  the  inhibiting  chain  of  reflexes  which  ! 

I  '  '  t 

I  w®  described  aboye^  these  chains  of  reflexes  -were  unneces- 
I 

I  sary  In  the  process  of  development  and  reinforcement  of  th^ 

I  I 

f uneondltloned  stimulus^  Only  the  application  of  one  of  the | 

!  I 

I  componentB  of  the  complex  Btlimilus  (a^  or  a,,-)  could  serve  J 

f  5  0  I 

as  a  reinforcing  factor..  I 

I 

I  In  this  manner  it  becarce  possible  to  form,  complex 

) 

I 

I  reflex  systems  consisting  of  several  "autonoraous”  ccndi-  [ 

I  tioned-reflex  chains .  Here  it  was  also  observed  that  the 

I  ! 

I  chain  of  reflex  reactions  de-velopea.  on  the  basis  of  rain*-  j 
j  forcement  by  one  of  the  components  of  the  complex  kStimulus  | 
i  or  ag)  was  not  carried  out  when  this  signal  (a^  or  a^)  i 

s  j 

f  was  cut  in,  ■  ■  I 

5 

i  Thus  in  conducting  this  series  of  experiments  we 

i  ■  ■  I 

5  I 

I  also  came  up  against  the  existence  of  a  special  category  |- 

I  of  '’triggering”  conditioned  stimuli^,  the  presence  of  v^hlchf 
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t,--(iWK  >-/-.*»«-ivu^''<«i^»vy»t,rf|Wi«fc-:'»rt»»aW.'-'jf«WM?.-it*»U  '***:'''*"*^  J''*’‘ ^  ***"  **"*  ^  T  .#  t 

made  it  impossible  to  carry  out  the  reflex  reaction  o  s-n 

in  question*  f 

i  'Jl-iesa  exparlmentE  may  te  taken  ae  a  bs  si  a  for  the  j 

!  following  ooncluslona  eoncemlng  the  algoi-lthms  at  the  j 

IbaalE  of  the  development  of  '  complex  conditioned  reflex  eye-! 

I  “  ' 

Items  (algorithm  No.  5)*  '  ,  ; 

j  1.  If  the  slEultaneons  ceo-oM-ence  of  the  -stimuli 

I  and  ag  coincldeu  several  tires  with  the  acquisition  of  foodj 
[but  each  of  these  stimuli  taken  alone  does  not  colnolaa  | 
Iwlth  the  acquisition  of  food,  then  a  conditioned  response  , 

?  .  I 

I  tc  the  complex  stliwalue-  is  vforkeid  out*  J 

j  Tlie  behaTrlor  of  the  animal  varies  as  follows;  a)  Ir^ 


I  the  simultaneous  presence  of  the  two  stimuli  Sj  ^nd  ag,  the 
I  animal  performs  a  motor  reaction,  fc)  In  the  presence  of  one 
I  of  the  stinrali>  the  motor  reaction  is  absent* 

2,  In  cases  where  coincidence  of  the  stimuli  a.;^ 
and  ag  occurs  frequently,  no  further  change  Is  observed  In 
the  beiavlor  of  the  animal.  If,  however,  the  stimuli  and 

rarely- occur  together,  a  reaction  Involving  tho  appaar- | 

O  i 

i ance  of  random  motions  arises* 

8 

3.  Thon^  if  one  of  the  randomly  executed  movement 
:e*g*,  bg,  coincides  several  times  with  the  appearance  of 
lone  of  the  stitAull,  e*g.,  a.3,  then  this  movement  is  remem- 
Ibered  and  the  following  changes  occur  in  tiie-  behavior  of 
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1 1 he  a.n jjitalt  a)  all  random  moTements  ceaeej  b)  the  motion  bgi 
arises  Immediately  in  the  absence  of  the  stimulus  Then  I 

lalgorithffi  No*  1  is  applied, 

A  new  reflex  chain  which  leads  to  the  appearance  of  I 

the  stimulus  wo2-*ked  out  on  the  basis  of  this  algo-  j 

rithffi,  '  '  ; 

.Hie  algorithms  described  above  may  provide  for  the« 

»  •  ■■  '  ■  .  .  I 

1  for-rsation  of  complex  behavior  patterns  In  the  animals  un dsn 

I  di  fferent  environmental  conditi.oiiS*  Hie  re'svlt  is  benavior  | 

■which  consists  of  a  whole  series  of  autonojiriDUS  conditioned  | 

1  reflex  chains  (polyphased  behavior). 

I 


CilAPTER  ?  '  , 

STiroY  0,F  THl’  LAWS  OF  FORI-IATION  OF  BEmiYIOR  PATIH^NS  j 
ON  Tm  BASIS  OF  PROCESSING  INFORMATION 
ACOWTOLATED  EARLIEf!, 


One  of  the  important  singularities  of  the  woric  of  f 
the  brain  as  a  highly  peinfeeted  -syEtem  is  its  capacity  to  I 
form  a  new  system  of  conditioned  reflexes  (ne;w  behavior  I 
patterne)  on  the  basis  of  proeesBlng  in.formatlon  which  was  | 
iaccumalated  earlier-  and  stored  in  th.&-  m&movj  in  connection  1 
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iriwffBiii 


virJU 


jvTith  new  inform- '■- 


I 


,.r>  an  a,” 


iun  arriving  from  the  environment* 
..i.mal  encoimters  nevj  environmental 


condl“ 


tio 


, .  .4ud  when  new  needs  arlse^  we  observe  a  new  behavior 


>Gtern  which  on  the  one  hand  is  a,pproprla.te  to  the  nature  t‘ 


}P' 

t  f 

pf  the  Blfaatlon  and  on  the  -other  hand  results  in  satisfac~[ 

Ition  of  the  animals  requirements*  Here  the  eKiergence  of  the 

t' 

i  .  ^ 

I  new  behavior  pattern  occurs  immedlatel'/  without  any  supple-f 

•  I 

mentary  developmen'fc  based  on  the  use  of  experience  accttriiu-  | 
lated  previously.  In  these  conditions,  howevei)  we  speak  of  | 

I 

the  formation  of  "purpocive^'  or  ’’reasonable"  behavior.  Kere^ 
It  is  Important  to  note  that  the  behavior  of  the  animal  i'n-j 
variably  amounts  to  a,  reaction  to  the  entire  complex  of 
sti.muli  acting  on  the  nervous  system  In  the  situation  In 
question. 

ITae  behavior,  of  the  animal  cannot  be  regarded  as 


the  sum  of  its  responses  to  -the  sot  of  stimuli  -which  have 
been  a-pplledj,  but  is  the  result  of  complex  processing  of  I 
information  v^hlch  v-'as  accumiulated  earlier  and  -stored  in  ths 
mamoryj  in  association  v?lth  new  information  arrlvlaig  from  f 

I 

I  outside..  The  study  of  this  phenomenon  Is,  of  great  interest* 

!  i 

to  cybernetics. 

Becantl-y^  the  02'‘eEtion  of  automatic  con-trol  systemi 
that  will  be  capable  of  using  information  accumulated  ear-  ; 
lier  in  ne\"?  sltuatlcns  '  to  adopt  nev?  purposive  solutions  I 


j-  ■'  ' ' 

fv^hlch  j.ead  t;o  the  attainment  of  a  useful  effeot  has  acquire-; 

\  \ 

I  pres  Bing  iri'iportancei  '  .  ' 

j  ’ 

k- 

I  Let  us  consider  certain  problems  which  arise  In  the 

I 

I  study  of  this  problem  in  its  general  form<=  ; 


uj/pose  that  a  certain  control  system  A’  can  per 


I  form  varlouE  aetlyltiees  ^  ^  and  gsx!  receive 

I  certain  items  of  information  from  the  ex™! 

I  i.  4.  3  iji  I 

i  ternal  msdlum,  I 

j  ,  I 

\  I 

1111®  systera  has  a  certain  store  of  Information  in  i 

i 

the  form  of  the»~coridltloned  reflex  8ystem.s  developed  ear-  ; 

i 

llers  a.^g~b0--a.^™b^“a^-bp^  eto,>  and  there  is  some  concrete  ,| 

,  \  i 

situation  (a  complex  of  stiraull  entering  the  system)  a,  .a^jl 

""  I 

ap,  ehcc,.  | 

I 

ITnder  these;  condltiojis^ ,  the  system,  is  faced  with  I 

I 

the  problem  of  developing  a  new  operating  program  b^r  means  | 

of  which  It  will  be  possible  to  obtain  some  result  ’’K”,  | 

I  Here  it' Is  important  to  note  that  although  all  of  the  slg- > 

nalB  arriving  from  the  controlled  object  {the  environment ) | 

are  already  laio-tcn  to  the  control  system  arsd  form  parts  of  j 

the  various  operating;  programs  composed,  earlier#  the  actua;| 

i 

combination  of  these  signals  nra;/  -be  entlr*ely  new*  | 

As  a,  result  of  the  control  systems  work#  there  '  | 
should  arise  some  new  optiiirum  behavior  pattern  appropriate  | 
to  the  specific  situation  (a,5#aj^#ag)  and  leading  to  the  I 
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yv^rtam  /.  M 


attalment  cf  the  defined  goal  (K),  In  other  words-  some  ' 

.  f 

purpoelve  form  of  behavior  should  be  worked  out,  > 

!  '  ■  ■  " 

I'  This  nev.'  operating  program,  obvicualy  develops  on  , 

1  •  ■  '  , 

I  the  basis  of  procegslng  of  information  aocamulated  earlier  , 

iln  the  ecurae  of  this  processing,  inf ormtlon  whichj  -first,,  { 

( 

scan  be  of  use  for  the  attainment  of  the  goal  K  and,  second,* 
lean  be  applied,  to-  the  specific  situation,  muBt  obvlouBly  bd 
I  selected,  from  tha  entire  Bia.ss-  of  information  stored  In  the  I 


I  memory. 


In  solving  the  problem  of  the  algor  itiims  capable 


I  of  proce£Sl,ng  Informiation  in  this  way.  and  tlrie  problem  of  | 

I  the  physical  realisiation  of  these  algorithms,  ifc  imst  be  j 
j  remem,be2^ed  that  in  the  case  ur.der  conslderatj.on,  the  con-  : 

!  trol  system  is  to  'a  conciderable  degree  formed  In  the  learr.- 

i 

j Ing  process.  This  leaves  its  imprint  on  both  the  very  or- 

i  .  » 

I  ganlEatibn  of  the  sy stam  and  on  the  pattern  observed  in 
I  the  retention  of  information,. 

As  we  have  already  noted,  the  Information  appeared 
I  to  be  stored  in  the  form  of  a  lai^ge  n-nnber  of  operating 
programs  which  v-ary  greatly  In  character  and  were  developec: 
at  different  times. 

It  is  obvious  that  in  the  procesB  of  working  oirt  a 

I  new  behavior  pattern,  certain  prooesBes  involving  the  sep¬ 
aration  of  various  segments  from  the  different  operating  I 


•h 


iprograma  developed  previously  and  combining  these  segments  = 

?  ,'■■■■[ 

Ito  form  ne-vi  systems  must  be  carried  out*  ' 


;  a)  Technique  of  Investigation  I 

i  For  study  of  this  probleitij  it  was  necessary  to  work  ; 

Jout  special  systematic  procedures  which  permitted  the  scudy 
jof  the  laws  of  operation  of  a  system  having  a  certain  store; 

1  ■  ‘  -  I 

lot  Information  in  various  sltixations.  The  expei’iirienter  rnueti 

I  •  -  .1 

[have  exact  knowledge  of  the  nature  of  the  information 
i  ■ 

f  •  •  • ; 

:  stored  in  the  memory  and  the  nature  of  t'he  newly-arrived  ;i 

■  ■  ■  ■  ■  ■  ,  ■  I 

inx'ormation*  I 

I 

For  this  purpose  v;e  used  a  technique  involving  ex-  | 

■  periraentation  on  animals  In  which  certain  complex  reflex  j 

I 

Bystems  had  bc^en  developed,  earlier.  This  techniq,u.e  permit t<^d 
study  of  the  operating  algor  itlims  of  the  brain  under  con- | 
ditions  in  which  the  animals  already  possessed  partial  or  | 

i 

complete  information  concerning  the  experirAentall //-created  | 


environment ,  These  algor 


provided  fo:c  the  seeking 


out  and  memorising  of  the  necessary  information  and  for  \ 
co-mplex  mechanisms  of  processing  this  old  information  in 
association  with  the  new  information  arriving  from  the  en-.; 

f 

vlronment,  obviously,  comnarison  and  regrouping  of  [ 

I 

information  of  various  types  is  of  great  IzKportance,  I 

I  ■  I 

f  I 

I  Complex  systems  of  nourishment  motor  conditioned  | 
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till®  t:6cbrilQVi.®  of  <i®v<ii!lopM0rit  of  whlcJi  b^s  a.li?©3.dy 
jbeen  described^  wr®  developed 'In  the  aniraals*  In  additlori, 
ito  thlSj  8.  watex^-r® Inf c need  chain  of  dnitiklng  x^efleiJCOE  'WdB 
{also  developed.  If  the  aniiuals  were  hnngr:^'’  and  not  thirsty. 


■  I. 


jthey  would  carry  out  the . chain  of  food  reflexes  and  would 
fnot  respond  to'  the  conditioned  stlrauTl  of  the  watex*  chain*  | 
I  If  the  anijr>al3  were  satiated  and  then  were  made  thii^Bty) 

I  they  Viould  react,  only  to  the  condittoned  stii-null  of  the 

•I  ■  1 

chain  of  di'inklng  reflexes.  The  a'ntmals  were  fed  to  satla-  f 

*  ■  •  .  '5 

|t:ion  In  the  course  of  the  experiments*  The  excess  qxTantlty 

icf  food  reiiialned  in  the  trough*  -The  dogs  were-  then  allowed  | 

I  ' 

Ho  become  very  thirsty*  Different  complexes  of  the  oondi- 
jtloned  stimuli  of  the  nourishment  reflex  system .were  ap-- 
|plled  while  none  of  the  3.1.gnals  of  the , drinking  chain  was 
I  adminieteT*ed  ♦  Here  it  could  be  observed  under  cex't-ain  ex- 
[perlinental  conditions  that  the  animals  developed  new  be- 

|havlor  patterns  which  Integrated  individual  Eeginents  ta.k’sn 

I  '  ■  .  ' 

I  from  various  pa-rts  of  the  food  and  water  conditioned-reflex^ 

!  systems.  The  new  beh^ivior  could  not  be.  reduced  to'  a  BJnvple  I 

1  ‘ 

I  sum  of  respon.aes  to  tiie  set  of  signals  adiiilnlstered,  Xn 

f 

everjr  case,  the  animals  responded  selectively  to  one  condi¬ 
tioned  signal  of  the  reflex  eystems  developed  earlier  and 
idid  not  respond  to  other  conditioned  stimuli* 

When  we  applied  different  complexes  of  signals  m 


i.-awmS 
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F.riYErlalily  observed  a  redlatribatlon  of  the  activity  of  the  I 
jonditioned  reflexes  of  the  pravlously  dave],oped  systesn  f 
fehlcli  v&B  chai^acteri Stic  for  the  given  case..  The  phenomenon; 
of  selective  activity  Is  of  great  slgnifleancej  since  it  I 
Jte-stlfl.€‘S  to  tha  presence  of  certain  processes  In  which  In-j 

I. 

Iformatlonaccuimlated  earlier  is  processed^  It  is  Important; 

!  ,  .  ■  '  .  ■  '  ?■ 
to  stress  that  study  of  the  process'  of  appearance  and  dis-  f 

.  ■  I 

appearance  of  the  activity  of  individual  condltloned"*reflex| 

reactions  under*  various  conditions  places  in  the  hands  of  | 

■  J 

the  experimenter  an  indicator  that  can  be  used  In  study  of  , 
the  brain's  operation,  The  ne'w  betiavlqr  patterns,  arose  Im-  ; 
mC'^dlately  in  the  animalS;^  without  any  additional  develop-  | 
fMcnt  as  a  result  of  complex  Information  processing’  in  the*  I 
I  bra  in.- 

i  In.  conducting  the  experrlmentSj,  we  knew  exactl'y  both  | 

I  ■  '  '  .  ^ 

the  nature  of  the  inforination  accumulated  earlier  (of  the  I 
ccndition-ed-'reflex  Bjatems  developed  earlier)  and  the  ha-  | 
:tu:r3  of  the  information  being  fed  into  the  brain  for  the  ,  ' 

first  'time  (the  ne-v?  signals)*  We  were  also  able  to.  follow 
:the  process  of  formation  of  nev;  condltloned'-reflcx  systems,; 

I  I 

V?e  noted  froHs  which  of  the  prevlo'asly^developed  eonditloned| 

i 

|re.flex  systems  and  under  which  conditions  the  various  geg-  | 

I  I 

imentEi  were  taken  a'rid  used  in  the  construction  of  a  new  be-  I 

lhavlor  pattern*  By  varying  the  form  of  the  e,xperlment  and  I 
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*.';''»«i*r*>''iv,i»v,|ii,-: 


b*''-  adnilnlfiterlng  vai»ious  complexes  of  stimuli^  we  were  able 

i  1 

^to  follow  the  processing  of  the  information  which  Imd  oeon  i 

accmaiTlated  earlier  and  the  Information  being  fed  to  the 

' 

Ibrain  for  the  first  time*  'i’hua  the  method  bed.ng  described 

i  ”  ,1 

ki^re  iriade  it  possible  to  detect  certain  algorithms'  in  the  j 
{  ^  ^ 

jbraln'p  operation  which  provl.ded  for  the  formation  of  new  ? 

|forms  of  ■ptirpoplve  behavior  in  new  situations,  | 

1  The  appearance  of  ^'selective**  activity  of  oerts.ln  | 

|eonditionad.--refl€X  reactions  was  an  objective  Index  to  cer-'j 
I'taln  tnfortia^tlon—processlng  imechanlsms  at  'vjork  in  tne  bi-alii|» 
iilere  certain  relationships  which  characterize  this  pheno-«  | 

i  I 

imenon  were  detected,  1 

On  the  appearance  of  a  new'  requirement;,  e*gi.jr  first? 

certain  elements  of  those  reflex  systems  which  are  directly' 

! 

related  to  the  acquisition  of  'water  (the  chain  of  drinking 
reflexes)  become  acti've.  In  this  process  the  activation  be 
ginS;,  as  It  v;ere?  .to  propagate  sequentially  through  these 
systems.  The  Individual  se.gi'aents  of  the  system  passed  into 


the  active  state  one  after  another.  | 

1 

If  in  thoSie  segments  of  the  system,  which  'ifere  ae- 
'tivated  t.hej’e-  was  at  least  one  stimulus  -which  .was  simul¬ 
taneously  p-resent  in  the  envli*onment,  the  corresponding  reJ 
flex  reaction  would  emerge.  If,  on  the  other  handj.  there  | 
no  0\.',ch  coincide'nce  of  two  Identical'  slg^jals,,  -then  the  | 


Ipr-ooe.'f'S  of  Kiuocesslve  activation  of  prevlouEly-developed  s 
reflE>x  systems  would  continue,  propagating  frora  one  ays  tern  ‘ 
jinto  another.  The  pattern  described  here  provides  a  basis 

.  i 

f  '  I 

ffor  certain  conclusions  with  respect  to  the  ways  In  v^hich 
jthe  brain  processes  in foriiiati on.  It  becomes  clear  that  in.™ 


I formation  accumulated  earlier  may  be  taken  from  the  memo  in-  i 

I  '  '  '  .  .  ’  ' 

[and  used  in  the  formation  of  new  behavior  patterns.  Here  v/e? 

f-  .  . 

I  discern  certain  rules  which  determine  the  use  of  old  infor-f 
.* 

|matlon,-  These  rules  include  the  necessity  of  activation  of  ? 
Iv-arlous  parts  of  the  s^/stem.,  as  ■well  as  the  necessity  of  ,| 

tne  presence  of  the  same  stimulus  In  the  actl've  section  of  j 

if 

the  reflex  system  and  in  the  environment.  Here  there  Is  no  ■■ 
process  of  comparison  between  accuxmdlated  Informiation  and  I' 
newly  aincived  info:rmatlon,  .  ,  | 

i 

This  technique  also  'makes  it  possible  to  cast  light, 

■  .  '  ’  .  ,  i 

on  the  role  played  by  the  special  system,  of  "triggering"  I 

\ 

stimuli.  The  appropriate  part  of  the  reflex  £?ystem  could  | 
not  becsomte  active  without  the 'presence  of  some  triggering  | 
stimulus.  This  phenomenon  is  of  grea,t  Importance |  it  pro-  I 

I 

vide g  for  selectivity  of  the  process  of  "sca,nriing"  of  the  j 
previously-»developed.  reflex  systems  ■(previously-aocumulatec^ 

: information)  In  searching  for  the  necessary  Information  and 

\  ■  I 

makes  this  process  dependent  en  the  presence  of  certain  | 
Islgnals  in  the  environment.  Due  to  the  presence  of  this  ! 


jmeohanisffi  t>ie  seai^ch  for  complex  information  in  the  brain  | 
idoes  not  in\oiye  scanning  all  of  the  information  stored  In  f 
I  the  iviemoryj,  tut  only  the  inspection  of  a  small  pai’-t  of  It  — 
inatiely.,  the  part  which  caii  prove  useful  in  the  gJ.ven  sltua-s 


’ tion, 


1  t)  Law’s  of  ProceBSing  F-eviously  Accumulated 

I  and  Newly  Ari’lved  Inforination  j- 

■  .  '  ■  ■  ,  f 

‘  The  followring  resalts  were  obtained  as  a  result  | 

I  of  conducting  the  experiments:  When  the  animal  did  not  | 

I  '  .  '  i 

3  experience  hunger  or  thirst  in  the  coxirse  of  the  experl-  ^ 

I  ,  •  ,  ,  i 

haent.i  it  wuu.ld  not  respond  to  the  conditioned  stimuli  of  ,! 

;  ,  f 

I  previously  developed  cond.ltioned*-i'’efle>r,  sy sterna,.  "When  It  j 

I  V'?as  made  thirsty^  conditioned  responses  to  certain  condi-  I 
\ 

*  ticned  stimuli  appeared.  Here,  the  appearance  of  activity 
'i  I 

1  of  the  individual  conditioned.-rofi  ex  reaction  was  aelec-  I 

!  ,  .  '  i 

!  tive  in'  nature .  Plr  st  to  become  ectlv'e  were  the  condi-  | 

i  < 

ificned  stimuli  of  conditioned-reflex  chsins  wrhich  were  \ 

\  '  I 

jdi.rectly  related  to  the  acquisi.tion  of  water  (the  chains  ? 

I  of  drinking  conditioned  reflexes).  Here,  in  tu:cn,  those 

i 

i  conditioned  reflexes  of  the  chain  which  were  closest  t;o  j 

5  } 

>  ' 

^  the  uncerditioned  reinforcing  factor  were  first  to  become  [ 

active,  I 

I 

In  the  event  that  the  correBpondlng  conditioned  i 

I 

atiiruluB  present  In  the  environme,nt-  slarultaneously  I 
with  the  activation  of  a  reflex  oliain,  the  ^ondd^lGnecl,.  re-^ 


Iflex  reaction  occurred.  Then  no  other  reflexes  of  this  I 


[chain  passed  into  the  active  condition,,  If^  however^  there  s 

fwere  no  conditioned  stimuli,  the  process  of  succsseive  ac- 
<■ 

i  ' 

[tivation  of  the  different  conditioned  reflexes  In  the  i 

fprevlouBly  developed ■ systemscontinued  further  development .  i 

i  ■"  •  ■ 

I  An  important  singularity  characteristic  of  the  dev- 

jelopinerit  of  this  process  consisted  in  the  fact  that  in  ^ 

♦  -  ,! 

leases  of  the  presence  of  the  same  Btlmulias  in  two  different 
conditioned-reflex  systems  (e„g.,  the  drinking  and’ feeding 
systems,*  the  feeding  and  defensive  systems),  conditioned- 
ref j exes  of  the  other  reflex  chain  (for  example,  the  sys-  | 

■  ’  .  ,  I 

tem  of  feeding' conditioned  reflexes)  would  proceed  to  be-  f 

come  activated  beginning  from  the  point  at  which  the  com-  I 

I 

raon  stimulus  occurred.  This  would  be  follcwred  lirimediately  | 
by  successive  "activation"  of  this  second  (feeding)  reflex  ^ 

I 

I  chain.  \ 

I  '  "  i 

f  In  cases  in  which  stimuli  of  the  feeding  reflex  | 

I  ■  ■  '  ■  I 

evBtem  were  not  present  In  the  envix'’onment^  b'tit  a  stxmulus  | 

i 

in  the  feeding  reflex  system  was  the  same  as  one  in  the  | 

i 

^defensive  reflex  chain,  then  a  process  of  successive  acti-  5 

vation  of  the  various  conditioned  reflexes  of  the  defensive, 

f  .  ■  •  } 

J  5 

i chain  would  occur*,  ■  | 

C  ?f 

t  ■( 

I  On  the  basis  of  these  experiments  we  may  draw  the  i 

I  ^ 

Ifollowlng  concluBlonB  ais  to  the  character  of  the  inform-  | 
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It  ion-pro  cessing  algorlthsr*  ■  that  forms  the  basis  for  the 


kevslopBient  of  nev?  behavior  patterns  (algorithm  muRber  6),, 

1  1,  On  the  appearance  of  thirst,  a  process  of  scan-- 

I  . 

jnlng  previously-developed  chains  of  drinking' conditioned 
reflexes  begins,  Here,  the  stlimiii  of  these  chains  are  suc-j 

jcesBlvely  compared  with  stimuli  present  In  the  environment  ; 

{  • 
jat  the  moaerit  of  time  involved.  If  matching  Is  detected, 

I  ■  ■ 

a  reflex  reaction  appears  and  the  nrocess  of  scanning  of 

I  ,  ' 

!ths  reflex  chains  is  dieconti:iuc-d. 


If  no  similarities ' are  detected,  the  process  of 


llnspectlon  continues  on  an  Increasingly  broader  scale,  cm- 


Ibracing  more  and  iriore  of  the  conditioned  reflexes  of  the 


ii  \\  y}- 

i 
\ 


previously  developed  chains, 

I 

j  2,,  If  no  conditioned  stimulus  of  the  drinkii;.g 

I  conditioned-reflex  chain  is  present  in  the , environment, 

■and  the  drlriklng  and  feedj-iig  chains  have  a  comsiion  canal- 
tloned,  Btimulua,  we  observe  the  beginning  of  a  process  of 
inspection  of  the  feeding-chain  stiraull  beginning  from,  the 
p>oint  at  v?hlch  the  c'onmion  etimulus  occurred.  Here,  the 
stimuli  of  the  feeding  chain  are  alvto  compared  v?ith-  stimuli! 
In  the  environment.  In  the  everxt'  that  coincidence  Is  ob¬ 
served  a  reflex  reaction  arises. 

3*  If  there  is  no  coincidence  and  there  is  a  sttra- 
jiilus  corajiion  to  the  feeding  and  defensive  chains,  Inapectlon  \ 
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;of  the  defensive  chain  of  neflexee  begins^  ,a.nd  so  forth, '  f 

I  ■  ■'  I 

I  The  algox^lthrfi  d©Bcr5-bed.  above  ma..y  res^ult  in  a  com-  I 


iblnatlon  of  segments  from  different  syst 


ems  of  previously' 


ideveloped  conditioned  reflexes  to  foria  new  functional  cohi-  | 


f pi exes* 


The  'prlnolple  of  this  combination  is  Indicated  in 


the  diagram  below. 


a.,—  'Dt-  &r—  h,-,—  a.-.—  b.2  —  cessation  of  painj 

__J-_ _ r.  r: _ 0  O  . 

ai.—  b'r-  a^—  b,.“-  a.,—  he-  b--?  —  food,? 


*’5  5 


3  ‘^6-  7  '  7 


:  8  8  9  9  _jl _ 3.0 

I 

As  a  result,  of  execution  of  this  algorltlm  there  t 

* 

occurs  a  process  of  consecutive  comparison  of  the  accutm-  | 

’  *  f 

lated  inforina.tion  with  ln.formatlori  arriving  f’rom  the  en-  | 
vlromnont^.  as  a  result  of  ivhlch  it  becomes  possible  to 
Idetect  conditioned-reflex  chains  which  correspond  to  the 
character  of  the  external  situation. 

( 

I  It  Is  important  to  stress  that  the  rerralt  of  per- 

ffcmrilnp:;  the  Informatlon-proceESlng  algorithm  described  I 

f 

above  ‘is  the  emergence  of  just  such  behavior  foivas  which  ,1 

-  ,  .  t 

on  the  one  hand  result  i,n  the  attainment  of  the  goal  set  [ 

I 

before  the  Eyfrteni.,  and  on  the  other  hand  correspond  exactlyi 
to  the  character  of  the  external  situation.  L 

I 

Phtact  corre  Bpondence  ■  of  the  newly-developed  be-  | 

havior  patterns  to  the  assigned  goal  is  provided  by  the  | 
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if a at  that  the  prooesB  of  inspection  of  prevlously-accunm-  | 

I  ■  '  '  f 

jiated  experience  begins  from  those  nerve  eleme^its  which  | 

icorreE'pond  to  the  nature  of  the -assigned  goal  (thi?:'St)«- 

f  ^  j 

'•Thus*  this  Insneotion  encompasses  only  those  reflfsx  B-ya~  | 

s'"  I 

items  which  can  lead  to  the  aeixulsitl-on  of  water.  On  the  t 

fother  hand^  corir’espondenco  of  tise  now] y ‘-formulated  behavior:. 

I  to  the  ex'ternal  situation  is  provided  as  a  result  of  the  | 

jproccBs  of  coitparieon  of  the  external  information  with  the  j 

I  conditioned-reflex  systems  developed  earlier.  j 

i  ■  .  I 

In  the  process  of  forming  a  new  behavior  pattern,;,  I 

•  '  I 

jinformEitlon  whlcdp  on  the  one  hand^-  can  result  in  attain-  I 

. ,  ,1 

Iment  of  the  g-oal.  placed,  before  the  system,,  and  corre»tpona3  « 

!  •  ! 

I  on  the  other  hand  to  the  conditions  of  the  environment^  j, 

lie  se],ected  from  the  entire  mass  of  information  stored  in 


p.:.he  memory  of  the  brain,  Here^  the  selection  Is  carried, 
l  out  tv•^ica1  First  those  cha.lns  of  reflexes  are  selected 

j  :  ■  ^ 

I  Which  can  prove  useful  in  the  attainment  of  the  goal  place(^ 
J  befoi-*e  the  control  sj/stem,,  and  then  the  small  number  of  | 


I  chains  which  are  appropriate  to  the  external  sltua-tlon  are  j 

I  i 

I  selected  .from,  -among  these.  \ 

I'  '*  \ 

i  It  is  im.nortant  to  note  .that  it  proceeds  from  our  I 

I  -I 

I  experiments  that  In, the  formation  of  complex  behavior  pat- 

*  .  ■  1 

Items  in  the  brain^  the  inspection  does  nor,  extend  over  | 

fall  of  the  Information  -stored  in  the  memo:r;<r.  The  Inspectiorl 
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:  of  the  Infopmatlon  Is  a trl c txy ' selective  In  nature.  An  ? 


{  insignificant  fraction  of  the  InforiTAtion  that  has  been 
I  accumulated-  in  the  course  of  the  Individual  lifetime  of 
\  the  animal  in  question  ie  Inspected  each  time, 

^  Study  of  the  queBtion  of  the  lliriltB  of  anpllca- 

I  ■  '  ^ 

I  bility  of  the  algorithai  described  above  and  its  effective- 


i  nesj 


under"  various  conditions  of  the  brain's  operation  are 


i  of  great  interest. 


I  By  vjay  of  answering  th3.s  question,  let  us  e.7r.amine  \ 

I  ] 

I  a  certain  system  that  has  a  certain  reserve  of  Inf ormatioi'i  ■ 

I 

I  in  the  form  of  cond.ltloned-refiex  chains  which  were  dev- 


I  eloped  earlier, 

I  us  assume  that  this  -control  system  caii  carry  of , 

I  n  different  activities  (b,  #  hr.,  bo.,+.b^)  and  sense  m.  ex-  | 

!  ^  I 

I  ternal  stimuli  (a.-,,  )  and  that  the  system  con-? 

\  \ 

I  '  '■ 

tains  a  certain  store  of  information  which  may  be  written  | 

^  ■  'i 

I 

I  in  the  form  of  the  scheme:  | 

t  i 

I  ag-  h^_-  3.^-  b^^water j  | 

.  _  -  f 


ag- 

•  V 

^6  ‘ 

\mf 

ua 
■  1 

1 

83- 

‘  \o" 

Pi 

-  '>16- 

Sq- 

’..J 

•  b.r~- 
u 

®-[  C 

•Am  ^ 

b„-^l 

.jJ. 

Let  us  suppose  that  the  animal  Is  hungry  and  the  f 

I 

signal  for  the  feeding  reflex  chain  Is  not  px^esent  in  the  5 
environment.  In  this  cavSe^,  In  accordance  with  the  algo-  | 
rithm  described  above>  processes  of  comparison  of  signals  | 


<  vrmntnari  lUHunK^w 
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,  of  the  feeding  reflex  chain  -with  signals  of  anothe?'’  eon- 

I  ditloned-reflax  chain  should  arise  in  the  eystern*  ^ 

;  Let  us  consider  the  problem  of  the  p'robabillty 

i 

I  of  the  itresence  of  the  same  signal  in  differ'ont  sy.stem.s 
;  together  with  the  problem  of  the  time  necessary  to  detect 
j  coi]icide2ice^  taking  into  accoiUit  that  if  coincidence  is 

I  '  ■ 

j  not  found  during  inspection  of  one  system,  a  sequential 

5  ' 

i  process  of  inspection  of  other  condl tioned-reflex,  systems 

‘  shou3 d  begin « 

•} 

I  The  duration  of  the  search  will  depend  on  the 

I 

I  values  of  ”n''  and  ''m".,  i,e»>  on  the  number  of  signals 
I  arj-^lvlng  from  the  environment  and  the  nimiber  of  possible  | 
I  activities  of  the  control  system.  The  larger  the  values 


f  of  ’’n"  and  the  greater  will  be  the  variety  of  the 

I 

I  previously  developed  conditioned-reflex  .systems  and  the 

!  •  ! 
i  loV'jer-  will  be  the  probability  of  coincidence  of  identical  ! 


I  stimuli  in  t/wo  different  reflex  systems. 

;  Ijiider  ccnditiois  in  which  “n”  and  "in'*  are  small 

! 

{  numberS;!  the  algorithm  described  may  prove  to  be  Inapplj..- 


I 


;  cable.  However,  In  o-ases  where  "n"  and  *'m'*  are  lax*ge  num¬ 


ber 


C/  U 


.he  Bearch  for  a  moment  of  coincidence  may  occupy 


i.  a  very  long  period  of  time  and  this  algorithm  may 'pro vw 
f  '  ■ 

I  useless. 


Consideration  of  the  "depth  of  Bearch”  in  the 
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I  iramoi^-  syptara  5.s  alf«6  of  gr«at- Interest,  As.  we 'have  al-  | 

ready  noted,  when  no  coincidence  occnrs  between  -  signal, .3  ; 

of  tb.e  feeding  x’eflex  chain  and  signals  existing  in  t.he 

|.  ,  '  ;: 

I  environment^,  the  process  of  corap»arlBon  of  Bignals  of  thlB  | 

!  ■"  h 

I  B-yatem  with  those  conditions^  reflexes  which  are  proBent  j 

I  l.n.  otherr  coriditionecl-r-aflex.  chains  shonid,  begin*  In  prac-  j. 

I  ■  '  ■  '' 

tlccj  this  process  m&j  contlni-ie  for  an  indefinite  period,  ; 


i  j, 

I  Here,  the  longer  (doepor)  this  proce-BS  de'v-elops.,  the  greateil 


be  the  mtnber  of  stiwuli  that  are  ooKparad  with  on,o 


ari'other,  Ihis  process  snay  pirovo  to  be  expedlerxt  within 


limits^  but  it  will ' obvioul sy  become  Inax™  | 


I  certain  narrow 

t  f, 

f 

I'pedlcnt  at  a  certain  stage  in  further  sear,chlng>.  siiice  it  i 

I  will  reaui,rs  a  great  deal  of  work  on  the  part  of  the  brain | 

!  ■■  ■  .  I 

I  and  the  expend! tu-ue  of'  a.  -great  deal  of  time,  * 

I  A  gen€‘ral  consldei’atlon  of  the  problem.^  set  for't'n 

I  above  leadE  us  to  the  tentative  conclusion  t.tet  the  alg-o- 
■  ’ 

I  rlthifis  deBcrtbed  above  may  pinove  expedient  ander  certain  | 

1  ^ 

*  narrowly  restjalcted  conditions  of  the  brain  ope  rati  ox).,  I 

They  'mB.j  prove  effective  in  certain  species  of  a.rJ.rna3,s  I 

axid,  Inoffectlve  in  other  species  of  animals. 

Among  other  thtng;s>  this  is  ■  Indicated  by  the  fact  f 

I 

that  bheae  algorithms  have  been  detected  in  clearly  ex-  | 

I  pressed  forms  in  experlriie^nts  on  dogs  and  white  rate,  ^ 

I 

They  appear  in-  very  primitive  forra  in  exp-ortmentE 
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on  blMa  and  are  totally  absent  in  ttirtlea* 

It  was  also  poet'lble  in  esrperlments  with  anliriGlE 
to  detect  other  algorith/p.s  vjhioh  mark  out  othe:c  ways  to 


I  solution  of  the  problem.  For  example^  It  was  found  in  ex- 


;  perdments  carried  out  with  rats  that  when  two  simple  con- 
f  '  ■  .  ' 

ditioned-reflex  chEilns  of  different  typeB  were  developed^,  \ 

^  '  ’i 

the  combination  of  segments  of  these  chains  into  a  hew  i 

I 

complex  on  the  basis  of  tho  presence  of  a  single  common  I 
stimulus  in  these  chains  could,  be  obEserved,  I 

f 


Such  combination  was  not  obsec’V'ed 


in  more-  complex 


I  oxpei'*im.enta,.  Regardless  of  the  uresance  of  a  .eommom  stlni-  'j 

I  “  ■  ■! 

ulu.9  in  the.  feeding  and  drlnk:ing  chains,  an  animal  -which  |.' 

♦  i 

was  experiencing  thirst  woul.d.'not  react  to  •  conditioned  s 

stimuli  of  the  .feeding  reflex  system.  .  { 

"  I 

s 

The  use  of  the  feeding  conditioned-reflex;  chain  | 
to  acquire  -water  (combination  of  two  Bections  of  different 

I 

reflex  chains )  was  not  obaervsd..  Together  vd-th  this,  a  | 

I 

reaction  associated  vflth  the  a-ppesrance  of  a  large  n-uj-nber  | 
of  different  t'jpeE  o.f  random  motions  on  the  part  of  the  j 

■  rat  (a  reaction  of  Inspsction  of  different  va-riants)  I 

I 

;  I 

emerged.,  | 


The  following  experiment  was  carried  outi.  When 

s 

[;-he  aniir;.al  felt  hunger  and  Ihlr^t  the  feeding  conditioned- 1 
reflex  chain  was  .  brought  into  operat.lon  in  the  course  of 


..-J 
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I  experiments  'Cn  absence  of  this  chain,  the  Btimuliis  'i.^hlch  ■  ^ 

pas  also  present  in  the  drinking  condltloned^reflex  ohaln  \ 
I  xRSxie  its  appearance*  Although  the  animal  did  not  obtain 

I  .  ;  ; 

I  vjater  in  the  co-urse  of  this  experimentj,  the  capacity  of  t 


'  the  brain  to  combine  eectlons  of  the  feeding  and  drinking  \ 

i  conditioned  reflex  chains  on ' the  principle  of  the  presence, 

s  i 

i  of  a  common  stlwraluB  was  detected  on  the  following  d.c^,  i 

\  i 

I  It  must  be  concluded  that  the  drinking  reflex  | 

i  -  -  I 

chain  which  was  not  reali'ssd  in  th^  course  of  our  exporl-  « 

insnts  was  in  some  sort  of  active  condition^  as  a  result  '•i 

of  which  the  appearance  In  the  environment  of  one  of  the  ; 

•  i 

stimuli  of  this  chain  waa  detected  by  the  animal  and  | 

i| 

served  as  a.  basis  for  subsequent  unification  of  the  tvio  | 

I 

chains  of  conditioned  reflexes.  [ 

The  following  conclusions  concerning  certain  algo~J 

ritlms  of  the  bx'-aln's  operation  may  be  drawn  on  the  basis  i 

. 

of  these  experiments.  | 

¥.hen  algorithm  number  6  has  been  carried  out  and  I 
has  not  led  to  the  acqulaltiorj  of  food  the  following  | 

changes  arises  a)  Inspection  of  previously  developed,  re-  'j 
flex  systems  is  discontinued^  b)  there  arises  a  reaction  j 
involvl.ng  the  appearance  of  numerous  random  motor  acts? 
the  nervous  elements  corresponding  to  the  conditioned 
stimuli  of  the  drinking  reflex  chain  are  kept  in  their 


I 
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I  active  condition  (/u  A.  IJlLhtomskly ’s  dorainant*-excltation  f 

I  condition  /62/) .  [ 

I  3'f  one  of  the  stimuli  of  the  dpinklng  reflex 

!'  '  ■ 
j  i 

i  chain  arlB.es  as  a  reBult  of  a  mover?ient  of  the  animals,  f 

i  f 

f  this  moveirant  or*  complex  of.  motor  reactionf^  is  r*emeKbex‘'ed ,  t 

-I  •  ! 

I.  A  iiew  behavior  patterti  may  be  erectcjd  on  this  basis,  ' 

!  '  '  ? 

In  this  case,  therefore,  the .  ss.a3.-*ch  .system  aBSocl-.J 

■  .  I 

i  ated  with  Inspectior  of  Information  a -c cumulated  earlier  | 

i  'i 

!  is  combined  vd-th  the  search  system  reali?red  by  means  of  | 

I  '  .  } 

i  :i 

^  motor*  reactloi;  directed  tcward  a  change  in  the  surround---.  1 

*  .  ■  • 

I  Inc  extoixal  inedlumu  i 

}  '  '  'i 

’i 

t  The  question  of  the  exped.lency  o.f  the  alp^orlfchm 

I  ' 

^  dofccribed  a,nd  the  liniitc  of  the  conditions  under  which 

f  I 

j,  it  can  lead,  to  a  iiBeful  result  may  be  answered  on  t.he  ,  | 

!  basis  of  an  analysis  similar  to  that  which  we  presented.  | 

>  '  '  .1 
I  above,  ¥e  shall  not  precsent  a  detailed  dlscxisEion  of  the  | 

t  I 

I  p'roblem,,  T.hs  tentative  conclusion  that  the  described  al-  i 

i 

I  gorlthm  is  expedient  only  undc-r  certain  conditions  and  ae  I 


i  applied  in  certain  species  of  aniirials  may  be  dr-avm  on  the 

I  .  ■ 

f  basis  of  ce.rtalri  general  considex'’ations.  One  indication 

f  ’ 

i  of  this  is  r.he  fact  that  in  higher  a-nlmals  (doga),  this 

I  ■  .  ■  j 

f 

{  algorithm.  Is  expressed  to  a  lesser  extent  than  in  white 
f 

I  4"  c 
I 

I  It  v/as  foxmd  rb  a  result  of  the  laYeBtlcra„tlo.nB 


deBcrlbed  above  that  the  presence  of  a  given  system  of  | 


I 


-reflexes  in  the  animal  does  not,  as  a  rule,  in  itself  pro-  ; 
vide  for  tha  emergence  of  appropriate  behavior,  Undear’  nor-  , 
mal  conditions  the  anlraal  does  not  respond  to  the  eondi-  I 
tioned  Btimtai  which  are  included  in  these  systems,,  llie 
action  .of  some  triggering  s.tlm.ulus  is  necessary  If  a  cer¬ 
tain  form  of  behavior  is  to  arise.  Only  then  does  a  spscl- . 
flc  behavior  pattern  begin  to  form  about  this  BtiiTiUlus 

(goals).  ,  ■ 

■I 

This  point  is  of  great  importance.  Under  their  ; 

■i 

natural- living  conditions,  animals  usually  fom  excesslvel# 

•} 

large  numbers  of  systexns  of  conditioned-reflex  reactions,  ] 

I 

InnimK-rable  stlirrali  are  present  at  all  times  In  the  envi-  ' 

V 

ronsiient.  If  the  animal  reacted  at  all  times  to  all  of  f 

these  stimiUli  its  behavior  would  become  a  chaos  of  cson-  ! 

I 

tinual  and  unrelated  movemients.  This,  however.  Is  not  ob-  | 

■■  ( 
served.  The  behavlox--  of  animals  Is  purposive,  f 

I 

At  any  gjlven  moment  of  time  animals  resect  oniy  t 

to  a  definite  narrowly  bounded  circle  of  stimuli  and  do  j 

not  react  to  all  other  conditioned  stimuli.  Without  the  f 

s 

above  capacity  to  react  selectively •  to  only  certain  ds-fi-  | 

I 

nite  environmental  stimuli  (namely,  just  those ' Btimull  :  | 

I 

which  are  necessary  undex*  the  conditions)  it  is  impossible  I 
to  imagine  purposive  and  efficient  behavior,  I 
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j  At  the  baais  of  this  phenomenon  v?e  find  the  foe- 

t 

I  mat Ion  In  the  animal  of  complex  conditioned-reflex  con- 
I  Btructions  which  possess  special  systems  of  'matually  siib- 
i  ordinated  "triggerii-.^*  and 'but-off  stlmnli  which  -tn  tin’n 
:  activate  various  reflex  chains*  Here  the  principles  of  or- 
f  ganisatlon  of  reflex  sjrstems  set  forth  above^,  which  are, 

I  associated  with  the  existence  of  additional  side  chains 

i 

I  of  reflexes  leading  to  the  attainment  of  Inteivnedlcite 
I 

j  goals,  are  of  great  value*  Such  a  system  provides  for  the 

I 

'development  of  purposive  behavior. 

Here  we  must  also  sti-^ess  the  significance  of  the 

t 

I  fact  that  different  reflex  chains  develop  on  the  basis  of 

f 

i  their  reinforcement  with  food,  water,  etc.,  then  lose 

I'  their  specific  value.  'When  a  new  need  aaolses,  they  are 

I  used  iinmedlately  to  satisfy  it.  This  phenomenon  is  of 
i 

I  very  great  significance.  If  there  were  a  special  and,  spe- 
! 

f  olflc  reflex  chain  at  the  roots  of  each  of  tie  rrmnerous 

I 

I  behavior  patterns  of  the  aniBial,  an  exceedingly  large 
f 

I  memory  capacity  v^ould  be  reauired.  A  system  Vv’hlch  permits 

t 

?  the  \ise  of  old  experience  under  variouE  new  conditions  Is 

j  considerably  more  economical  with  re  E-spec  t  to  the  number. 

\ 

i  of  v-iorking  elements  required,.  Such  a  system  must,,  '  however, 
I 

I  possess  specific  itiechanisms  which  provide  for  a  memery 
isearcn  and  for  processing  of  the  necessary  inforrr»ation. 
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I  In  connection  Mitli  this  problem  we  feel  it  Im™  > 

portant  to  mention  certain  specific  properties  related  ; 

I  to  the  storage  and  location  of  Infoi’Hiation,  J 

i  i 

[  We  iffust  first  emphasise  the  significance  of  a  j 

[■  .  > 

j  asfinlte  system^,  a  definite-  organisation  In  the  storage  i 
i  of  Informtion.  This  structure  may  be  represented  in  its  ^ 

i 

!•  : 

I  general  form  as  a  highly  branched  system  which  combines  s 

!  ■  ! 

I  Interconnected  reflex  eliains  in  a  singular  manner^  > 

i  a 


A  B 

^  J 

a~.-,  V 
K.,  /  E 

I 

K ..  g 


- - 


■^1 


■p  ^  L 

I  In  this  d lagraray  the  upper*».c.aBe  letters  denote 

I  S 

i  ■  -  ^ ,  V.  -  i 

■various  environrr.ental  stliroili  (E.«  R.,  !<>  Kp,.  and  so  | 

V  .  I 

I  forth).  The  lower-case  letters  denote  the  corresponding  | 
icellfj  of  the  I’eceptor  zone-  of  the-  cerebral  cortex.,-  and  .K..  ;<  J* 

^  ■  1  j- 

!  and  are  tx'lggering  conditioned  stimuli,  I 

1  This  diasrara  does  not  pretend  to  be  an  accurate  I 

I  .  ■  ■  .  ! 

I  reflection  of  realltyy  but  It  does  ,perm.it  clearer  v.1.  suall- f 
j  nation  of  certain  principles  of  the  systera^B  structure,  j 


15^ 


Characteristic  proper-ties  of  this  structiire  a3?ej  | 

■  ■  '  ( 

fi3'*'St^  i.tg  trse-like  bi’anshed  struct'ore  and  second^  the  f 

presence  of  systems  of  triggering  stlninll  of  different 
i  categories  (K,-^,  K^,  .K^,  ate,)*  | 

I  J.  jC-  ^  I 

j  It  may  be  sunposed  that  the  procssn  of  propagation  \ 

\  *  ■  ^ 

‘  of  an  excitation  wave  ovei-’  the  system  of  nerve  connections  ! 

! 

and  the  phenomenon  of  addition  of  excitations  in ' the  nerve  I 

I 

eells  is  of  great  eignificance  in  the  .search  for  the  neceB‘| 
sary  inforrijatlon  in  the?  memory  system.  Let  ue  consider  | 

.ii 

I 

I  this  phe-noi/ienon.  As  v/e  have  already  noted^  the  animal  doas  ] 

•  .  ■  i 

net  under  normal  conditions  respond  to  the  conditioned  | 

stimuli  Included  in  this  system  (A,  M.,  H,  etc,).  For  | 

*  •  i 

any  reflex  activity  to  arise, 'it. is  necessary  that  one  | 
of  the  triggering  conditioned  stiiraili  appear*  (iCj^.or  Kg,  | 
etc*)*  Tliis  la  denoted  on  our  diagram  by  the  letter  ♦  I 
When  this  Etlmulus  acts,  an  excitation  wave  arises  at  the  { 

I 

point  K^,  and  begins  to  propagate  thi-ough  the  entire  sys¬ 
tem  of  conditioned-reflex  connections  with  which  the  point 
K't  lE  connected.  The  result  of  this  pi'ucess  will  'depend 
on  whether  the  corresponding  external  stimulus,  P,  G,  or 
A,  iB  present  at  the  given  moment  of  time  in  the  environ¬ 
ment*  If  such  a  stimulus  is  present  a  process  of  S'tiT?!matlon| 
of  excitations  is  effected  in  the  corre spending  nerve  | 
cell  and  a  motor  refi.'ex  reaction  arises.  If,  however. 


155 


ther'=e  Is  no  s-ach  stiKmlusS.  tha  reflex  response  does  not  I 

t 

arise  and  the  excitation  wave  "begins  propagation  tiiro'ugh  I 

other  structaros*  .  ' 

It  may  alEo  happen  that  the  conditioned  stlmrlus  | 

\ 

i  (l)  is  present  In  the  environment  htit  that  the  conditioned  | 

f 

I  Inhibitor  (K^)  which  prevents  the  performance  of  the  re-  ‘ 
t  i  . 

\  flex  chain  i— 2;--I  Is  also  present  simltaneoiiBly,  In  this; 

\  ■  I 

I  case,  an  excitation  focins  is  created  at  point  just  aa  j 

'  £^.  ■  i 

!  it  was  at  point  Kl  earlier.  This  excitation  begl.ns  to  pro-~j 
}  1  . 

pagate  through  the  systems  of  connections  and,  0--  \ 

F-'-R,  The  result  is  the  formation  of  behavior  which  leads  ,i 

I 

tc  the  removal  of  the  conditioned  inhibitor  (K^)*  Ifj.  how~| 

ever.»  a  new  conditioned  inhibitor  (K^)  stands  in  the  wsy, 

the  process'  continues  further  on  the  same  principle.  In 

our  consideration  of  this  scheme  It  is  necessary  to  note 

that  it  provides  for  rapid  location  of  the  necessary  In- 

formation^.  The  back-tx'acing  process  accompli slmed  in  the  I 

I 

system  in  the  course  of  propagation  of  the  excitation  j 

I 

wave  over  the  systems  of  conditioned -re flex  connections  i 

-f 

encompaesee  only  a  certain  very  Email  part  of  the  ''memory'’! 

I 

--namely,  that  part  of  it  which -is  associated  with  the  | 

i 

i 

triggering  Etiimalijs  (IL),  Here,  the  system  of  triggering  | 

X  .  ■  I 

stimuli  ICj,  Kg,  etc.  which  create,  as  it  were,  a  spe-  j 

■  i 

ciflc  system  of  subordination^  are  of  great  significance ♦  | 

_ _ _  ,  . . . . 


c 

leaB***! 


fsannm> 
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i  Ab  a  results  the  process  of  irrational  (idle)  tracJ.ng  te  | 
f  ,  -  I 

f  reduced  to  a  mlniiiium*  i 

!  ^ 

f-  ■  '  '  ' 

I  Nor  iB  It  difficult  to  see  that  as  a  r-aault  of 

I 

I  propagation  of  the  excitation  wave  through  the  system  of  ( 

!  s 

'  prevlously-develoued  connections  and  the  phenomenon  of  [ 

:  “■  ( 

I  st:matlon  in  the  nerve  cells,  there  has  been  effected  a  :? 

t  .  ■  ■  ■  I 

i:  comparison  of  the  external  information  entering  the  brain  i 

1  .  I 

t  with  the  system  of  nrevtouslsr-formed  nerve  assooiationsj,  If 

!  I 

I  as  well  as  a  process  of  re -combination  of  systems  of  pre-  | 
i  viously  formed  associations „  j 

i  .  ■  '  ' 

I  As  a  result,  behavior  which  corresponds  exactly  ? 

I  f 

-t-c  the  environmental  conditions  and  leads  to  attainment.  :l 

I 

I  of  t’le  neceesary  goal  is  formed  In  each  case.  In  the  for-  | 

I  mation  of  this  behavior  pattern^  the  organism  obtains  | 

1  '  '■  i 

large  cixan titles  of  external  Info rmiat ion  and.  here,  as  it  ] 

\  '  I 

I  were,  the  brain  actively  selects  this  information.  In  any  | 


given  moment  of  time  it  rsosponds  only  to  a  definite^ 
etrictly  limited  group  of  cxter'nal  stimuli. 

It  must  also  be  noted  that  a  large  number  of  dlf- 
!  ferent  behavior  patterns  may  be  formed  on  the  basis  of  a 
I  single  system  of  conditioned  reflex  .a.BSoclatlons,  in  ac- 
I  cordance  with  the  conditions  in  the  environment, 

I  c)  The  Study  of  More  Complex  Infor- 

I  mat ion -Processing  Patterns 

I  Finally,  we  must  consider  a  case  In  which  the 


f 

I 
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I  formation  of  a  new  operating  program  for  the  brain  in  | 

I  ' 

i  determined  not  ty  one  but  by  several  conditi.onB*  As  In  ; 

^  ! 

[  tho  case  considered  above,  the  emergence  of  a  iiev  external  , 

\  . 

I  ■  ■ 

j  slt\aatlon  and  the  appearance  of  a  new  goal,  in  the  operation 

t 

I  cf  the  control  system  serves  as  a  basis  for  the  formation  ; 

i  of  new  behavlor=  patterns.  The  esBentlal  difference  con- 
i 

\  slBts  in  the  fact  that  .togethe??  with  the  neceissity  of  ob-  f 

i  i 

i  \ 

I  tainlng  a  definite  goal,  the  control  system  must  take  into*' 

!  i 

t  I 

I  acooujit  the  necessity  of  avoiding  certain  Blti;Ea'bions  which? 

■  ",  I 

I  may  prove  aetrimental  to  It  In  Its  formation  of  the  new  i 


beitjavl.or  nat terns , 


I  Such  conditions  may  bo  encountered,  very  freq'uently I 

I  both  in  the  life  of  animals  and.  in  the  operation  of  the  f 

?  i 

.  ? 

varioi’s  machines  which,  control  the  work  of  industrial  en-  I 


.•■erDr'lses. 


f  Under  the  :n.atu.ral  living  conditions  of  organ!  sms^  [ 

I  i 

i 

it  Is  very  .frequently  neceBBary  to  find:  a  behavior  pat-  I 

tern,  which  will  lead  to  the  satisfaction  of  some  req'iii:re-  | 

ment;  (acquisition  of  water,  food,  etc.)  and  at  the  same  | 

time  to  avoid  situations  which  may  present  a  threat  to  i 

.the  ll:re  of  the  given  individual,  as  well  as  to  avoid,  I 

I 

painful  stlrrall  in  performnce  of  the  .new;  behavior  pattern | 

I 

Conditions  for. the  avoidance  cf  certain  situational 

I 

which  rnig;ht  lead  to  breakdown  or  damaf^e  of  the  eciuiisment  I 
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f during  the  formation  of  a  new  operating  program  can  also 
I  be  eetabllBhed  in  the  operation  of  control  systems « 

I  In  this  case  the  control  system  must  possess  new 

I  capabilities  which  rmast  enable  It,  when  a  new  expedient 

f 

I  behavior  pattern  has  been  formed,  to  ^'foresee’’  all  IjOBsI- 
I  ble  secondary  consequences  to  which  the  performance  of 

I  ■ 

)  this  behavior  pattern  may  lead;  it  must  be  capable  of 

f 

j 

;  forming  new  behavior  patterns  which  will  De  aDle  to  hold 
1  the  -aseful  effect  of  the  behavior  unchanged  and  at  the 

I 

j  same  time  exclude  the  possj-billty  of  the  appearance  of 
I  negative  (painfu3 )  effects, 

j  The  following  experiments  were  carried  out  for 

I  study  of  this  nroblemt  Several  different  s-ystems  of  con- 
!  *  ' 

I  ditloned  reflexes,  one  of  which  Involved  the  application 
1  of  a.  painful  stimulus,  were  developed  in  animals  (dogs  and 

f  ■' 

5 

I  rats), 

Pet  us  present  the  diagram  of  this  system  of  con- 
1  ditloned  reflexes. 


^3"  ^2"'  ^'1 


—bp— food J 
■oainful  stimuluB.; 


ap—  bp.—  a^p  bg-elin^lnatiori  of  a^j 
a.j—  by—  a^^—  b0-a’'jater. 

It  will  be  seen  from  the  diagram,  that  a  nourish- 
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I  isiBirt  reflex  chain  was  created  in  the  anliiia,!  In  addition  f 

:  to  certain  defenBlvc  reflexes*  Hez-e,,  the  conditioned  sig-  ( 

rial  for  triggering  of  the  painful  stimulus  was  a  complex 

I  of  stimuli  consisting  of  the  two  stlmtuli  aj_|_  and,  a^,*  One  ,■ 

c.f  the  coBiponantE  (a*,)  of  the  Etimulus  complex  was  con-  i 

nected  into  the  nourishment  reflex  chain*  Tiius^,  if  the  ^ 

'  sttiflulus  was  present  Ivi  the  enytroiurisiit^  a  sltziatlon 

was  created  In  which  the  animal  Itself  actively  triggered  ? 

> 

:  .  I 

I  the  stlniulUB  in  the  pr'ocess  of  p>ex'-f or*mlng  the  nourish- 

fC.  '  i>  . 

ment  reflex  circuit,  ■  with  the  result  that  condltio-iB  were  ■! 
created  In  which  he  Z'eceived  a  painfu.l  BtimuluB,,  Then  a  j 

I  reflex  chain  was  woiTred  out  to  eliminate  the  painful  stlm"| 

I  I 

I  ulus.  This  conditioned-reflex  chain  was  reinforced,  by  .  ] 


elimination  of  the  signal  ajj*  In  addition  to -this  a  drink-f 
ing  conditioned-reflex  chain  'which  had  one  Btiruul'us  (a.,)  \ 

Jv  I 


i;  in  common  with  th^-^  nouriahme:rit  conditioned-re  flex  chain  s 
S  . 

;  t 

(  'oas  aev'cloped*  I 

I  1 

I  The  experiment  'was  conciiicted  as  follows}  Tlao  ani-  | 

I  mal  was  alloxced.  to  become  hun,gry  and  given  an.  e.xce3Bl've  !; 

■I 

I  oraatltv  of  watei*  fa  dish*  with  v-jater  was  present  in  the  I 

I  ^  '  i 

chamber),;  under  these  conditions,  the  following  expen:*! | 

rr.6.ntal  sltitatlon  was  created}  The  sigrial  (one  of  the  \ 

.  compone:ntB  of  the  complex  painful -stlm-ul us  signal)  a'nd  | 

'  'I 

the  Bimal  a~..  (the  conditioned-stimulus  of  the  chain  whlchs 

^  V  ■  ■  I 


l6o 


ti*iggej?ed  the  signal  a.i,}  wen-s  ad.nilnlst®):*ed.  "Kie  anxinal  f 

did  not  reEpond  to  these  stimuli,  Tlien  after  a  certain  j 

f 

iriter-Yal  of  t5-w.e  the  stlm.ilus  (the  conditioned  stimu™  ■ 

I 

I'us  of  the  water  conditioned-reflex  chain)  was  applied,  | 
These  conditions  created  a  definite  situation  which  the  | 

■I 

aniBXfil  was  encotinterlng  for  the  first  time.  This  sltna  i/ion  J 
voas  characterized  by  the  fact  that, "by  combination  of'  tne  , 
drinking 'and  feedi.ng  reflex  chains  on  the  basis  of  the 
presence  of  a  single  coraiiton  stimnlus  possible 

to  form  a  system  of  reflexes  by  means  of  vrhich  the  ar.tm.al  ■ 
could  obtain  food.  In  order  to  obtain  food  It  was  neces-*  ; 
&o.j;r  for  the  animal  to  respond  to  stimulus  a.y.^  but  at  the  | 
sunr-  time  this  situation  was  characterized -by  the  fact  j 
tha-^  the  animal  itself  load  to  trigger  a  painful  stimulus 
in  the  process  of  porforrning  the  reflex  chain. 

The  experlm,ent  showed  that  a.dminlBtratlon  of 
stliaulus  a,^-  did.  not  evo^ce  the  corresponding  reflex  reae-  I 
tlon^  but  gave  i^ise  to  a  completely  dlffei^snt  effect.  I 
Tjistead  of  carrying  out  the  reaction  to  s.j  upon  applica¬ 
tion  of  this  stimulus,  the  animal  exhibited  the  reaction 

to  the  stimulus  a,.,  (the  conditioned  stimulus  of  the  chain  I 

b  '  1 

of  reflexes  that  eliminates  the  signal  a^), 

I 

i 

The  result  of  this  was  the  accomplishment  of  a  | 
conditioned-reflex  chain  which  led  to  the  elimination  of  .1 


I  one  of  the  components  (ajj^)  of  the  complex  painful “-stiBrn-  | 

lua  signal  +  Ti'ieneafter’,  the  animal  would  react  to  the  J 

atimulus  (the  condl,tloned  stimulus  of  the  drlrikiiig  re- 

;  flex:  chain)  andj  having  created  a  composite  conditioned-  j 

I  I'eflex  chain;,  would  obtain  food*  Thus  it  found  a  method  | 

I  to  obtain  food  without  experiencJ-ng  the  painful  stimulus  ' 
i  •  ; 

{  in  the  process^  ■  I 

!  I 

I  It  must  be  remembered  in  analy2;ing  the  results  of  I 

i 

this  €Xpei»j'jnerit  that  the  situation  described  above  had  | 

:  been  creatcid  for*  the  first  time  in  the  anirTal's  experience | 

i 

Therefore^f  the  expedient  solution  of  the  problem  which  | 

I 

enlarged  was  a  -product  of  complex  analytic -synthetic  ac-  | 

i 

tlvlty  of  the  brain.  Each  of  the  three  conditioned  x^eflex  | 

I 

chains  emunerated  above  was  developed  independently  of  I 

the  o'therSj  and  they  were '  combined  for  the  flr,st  time  , 

under  the  conditions  of  this  experiment.  ? 

[■ 

Tiie  ex'oeriment  descr^lbec  above  indicates  that  the  * 

! 

brain  possesses  a  complex  mechanism  which  permits  it  to  j. 

I, 

fo'cm  new  behavior  patterns  on  the  basis  of  previously  ac-  i 

.1 

oumxilated  expei‘lence;  taking  into  account  a  >fhole  series  I 
of  factorsi  the-  experiffient  also -opens  a  way  to  scientific  | 
enaiysis  of  this  phenomsiion.  It  must  be  noted^  however;,  \ 

k 

that  the  algorithms  described  above  in  relation  to  the  | 

I 

I  propagation  of  excitation  across  sys'tems  of  previously  I 
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developed  eonditionad-reflex  asaoeiations  cannot  fully 
account  for  this  phenomenon:. 

It  majr  be  aaaumed  that  once  the  definite  behavior 
pattern  was  formed.*  a  new  process  conplex  was  realized 
which  permlttsd  the  -animal  to  fores-ae  all  possible'!  nega¬ 
tive  resultxS  to  which  this  ■behavior  might  Ic-^ad  and  to 
work"  out  reaction  patterns  by  means  of  which  these  nega¬ 
tive  consequences  could  te  eliniirateci,,  The  questions  con¬ 
cerning  t:h.e  algorlthias  and  physiological  mechanisms  form¬ 
ing  the  basis  of  this  phenomenon  are  as  7/et  for  the  most 
part  unclear.  Further  v?ork  is  necessary  in  this  respect*  , 

CHAPTER  VI 

Slrilfl/ATION  OF  THE  LEARNING  PROCESS 

The  present  chapter  is  devoted  to  a  description  of! 
an  automatic  device  created  v^lth  the  assistance  o.f  the  | 

i 

authors  of  the  book  on  the  basis  of  study  of  certa,in  prln-| 
ciples  of  the  oi)eration  of  the  brains  of  animals*  | 

Tills  was  done  with  certain  purposes  in  mind.  —•  In  | 


particular*  the  verifleation  of  certain  conclusions  drawn 
as  a  result  of  conducting  experiments  with  animals,  ■ 
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j  a)  Por’iTulation  of  Proljlem,  ■  ! 

I  The  Porrual  Neurons  of  MacC'ullough  and  Pitts 

i 

I  Simulation  of  the  learning  process  has  attracted 

|the?  attention  of  many  selentlsts  over  a  long  period,  of  tltne:. 
^Ihe  first  attempt  In  this  direction  was  probably  the  : 

I ''turtle'^  of  Grey-felter^,  However;,  the  "conditionad  reflex” 
[that  could  be  developed  in  tlie  turtle  seemed  too  artlflelalt 

I  .  '  f 

I  Tha  conditioned  reflex  has  alao  been  Biniulated  on  i 

t  * 

i  •  ■  : 

|goj.rar3,l~'puu'’pose  computers.  This  course  of  action  perTxlts  ? 
jonly  super-ficial  statistical  study  of  the  reflex, 

I  As  far  as  we  know,  no  attempt  has  as  yet  been  raade 

f  ■  ■  ■  !i 

I  to  dev'oiop  complex  conditioned-reflex  chains,  '  ;; 

I  The  automatic  device  to  be  described  represents 

t  I 

3'ucli  an  attempt,  Sirn.ulatlon  of  conditioned-reflex  develop-  | 

I  * 

Iment  w5.th  the  general  purpose  computer  is  posBible  but  not  j 

I  '  ■  ,  i 

jaa  Interesting,  since  no  hypothesis  concerning  the  actual  ! 

f mechanism  of  reflex  development  is  advanced.  'By  creating  | 

an  automaton  specifically  for  the  purpose  of  Btudyj.ng  the  | 

<■ 

mechanism  of  forj-naticn  of  coraplex  reflexes  may  propose  { 

•  f 

i 

a  series  of  hypotheses  concerning  the  neurophysiological  j 

I 

m,echa.nlsm  of  their  formation,  ■  .  i 

t 

The  description  of  the  automaton  will  be  given  as  I 

;  i 

IfollowB;  the  acheme  will  first  be  consti’ucted  using  the  | 


Iform.al  neurons  of  MacCullough  and  Pitts  and  then  certain 


■xBsWffRWs; 
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) 

Ischeinatic  dlagrans  In  accordance  Kith  Khich  the  actual 


|autoraatcr).  waB  constructed  will  be  glvrn*  ; 

I  -  ■ 

f  The  MacCi?llougli  and  Pitt's  concept  of  the  nerve  pet- 

I  f 

•■work  was  presented  above  ( diapter  II )»  Here  we  shall  con--  | 

jSider  the  gereral-^purpose  element  —  the  formal  neuron  of  J 
i 

I  which  the  MacCulloug}i  and  Fitts  nerve  networks  analyised  In  ‘ 
j  Chapter  II  consist  ■—  in  greater  detail*  I 

I  •  ? 

J  On  the  basis  of  certain  assuiaptions^  MacCul lough  and| 

iPltts  /4l/  arrived  at  the  conclusion  that  a  girnpllfieci.  modef. 
}  i 

'Of  the  neu-ron  -  the  formal  neuron  —  could  be  used  in  analy-j 

I  .  .  '1 

jsis  of  logical  networkE.  Tills  netiron  consists  of  a  body  or  J 

'  I 

One  or  more  terminal  plates  of  other  neurons  may  be  | 
^applied  to  the  body  of  the  neurorij  these  excite  It.  The  ,  j 

[  i 

i terminal  plates  may  be  exciting  or  inhibiting  In  nature.  \ 

[  '  1 

I  Dae  interval  separating  the  body  and  the  terminal  plates  ls| 

I  ' 

I  called  a  synapse,  'Nerve  fil aments  (axons)  v^hiich  terminate  \ 


Pig.  1.  Tlie  formal  neuron. 


in  similar  terminal  plates  extend,  from  the  body  cf  the  neu-| 


Each  iie-urow  IB  charaoter-lzed  by  a  nwsiom-  h  -~  its  I 

i  ■  ■'”  ■  I 

[threshold,  Tiie  tlireshcld  is  the  nilnimutn  cliff erenee  oe tween  j 
the  number's  of  exciting  and  Inhibiting  plates  which  result^- 
in  excitation  of  the  neuron,  I 

We  shall  represent  the  neuron  as  shown  In  P'ig,  1.  j 

Ex.clting  plates  are  denoted -by  dark  circles  and  Inhibiting 

■jr  ; 

plates  by  open  circles,  Tlie  ntiijuber  which  characterlseB  the 
threshold  will  be  written  -in  the  body  of  the  neiur'on.  For  ^ 

i, 

the.  neuron  M  (Fig,  1)  the  thresl-iold  Is  twop  this  means  thatj 
for  the  neuron  to  be  excited  it  is  necessary  that,  t'wo  ex~ 
citing  plates  or  one  inhibiting  and.  three  e-xcltlng  x>l®teSj 

■f 

etc.^  be  excited  simultaneoxmly.  j 


b)  Simulation  of  the  Simple  Conditioned  Reflex 

! 

Let  us  turn  now  to  the  structure  of  the  auto3ta-ton,  | 
Tlie  first  problem  that  arises'  in  simulating  the  learning  f 

I 

process  is  tJiat  of  simulation  of  the  Bimple  conditioned  | 

I 

re^flex,  | 

We  shall  cpnsi.der  the  automaton  in  interaction  wlttj 

an  enrironraent ,  The  environment  will  be  described  by  a  set  \ 

.  I 

of  .stimuli.  Let  us  denote  them  by  ,  ,1.  Hie  automatclr 

jI,  f 

f 

will  be  described  by  a  set  of  actions  (reactions  to  exter-  | 

I na,l  stimuli)  ,,,  ,a.„.  The  activities  of  the  a'utoms,ton  I 

i  .  X  aI  I 

fare  directed  toward  a  definite  goal  —  the  .acquisition  from  I 
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■  ..  % 

■Jti'e  environment  of  thf>  sustenance  N  (nnconillt loner! '  stinruiuf^  | , 

f  '  ■  •  '  .  I 

|lt  Is  possible,  of  co-arse,  to  characterise  the  medium  by  ; 

jmeans  of  a  set  of  unconditioned  Gtimuli  (in  a  real  medium,  ■ 

^  I 

I  food,  'v/atsr,  etc,,).  In  constructing  this  automat  on,  howeverj  I 

jthc*  problem  was  simplified  and  studied  xvithout  a  srngj.e  uii-; 

i  ■  ,  I 

fconditicned  etlimiliis.  ,  .  | 

i  •?. 

^  In  any  real  siti^atlon  (medium),  acquisition  of  the  ? 

]  ■  'I 

?  sustenance  N  reouires  the  perfonnsnee  of  a  dejlliiite  sequence 

r  '  ..  -v.L 

lof  activities,  each  of  vfnlch  is  evoked  by  a  certain  stiriralup] 

i  .  ..  .  i 

hthe  appearance  of  this  stlmu3-us  is  a  coni’irniation  of  the  j 
I  correctness  of  the  preceding  activity,  i,e,,  a  reinfo3n;lng  | 

*.. ""actor.  In  this  imanner,  each  concrete  situation.  1b  deacrloeld 
buy  a  chain  of  the  form:  f 

I  .  j 

I  y^yex'c  T,  are  the  external  stimuli  |  a.  are  the  actlvitiens  oi| 

I  the  a-.itomaton;  N  is  the  goal  {the  unconditioned  stimuluK),  | 

I  *  .  .  •  •  i 

'i  The  kUJtornatons  learning  process  proceeds  hackwax’d 

I  ■■ 

fi.e.,  a  simple  conditioned  reflex  Is  foi-med  first?  | 


i 


Than  the  stimulue  Is  in  turn  reinforced  in  de-  |' 
veloplng  the  'next  link  of  the  chain,  since  It  is  now  dl™ 
rectly  related  to  the  unconditioned  stimulus  N  through  the  j 
activity  a..  To  obtain  the  sustenance  N  (for  example,  food  I 

i  ^  I 

Ifor  the  anlm.a‘1 )  It  is  aufflolent  to  perform  the  activity  a,,i 
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l-on  bhe  app&ax'Ence  ol*  tii©  stiiifi’il'us  4-|,*'  | 

I  However ^  the  external  conditions-  may  change  and  the? 

jmediuffi  may  not  respond  with  the  appearance  of  the  uncondi-  j 
itioned  reflex  when  .the  stlmulns  Xg  evokes  the  response  a^.  j 
i Then,  obviously;  the  aiitoraaton  should  "forget"  this  relleA  lav 
[order  to  develop  a  new  one  which  is  useful  in  this  situatloi-. 
'^aliis  point  was  not  taken  into  consideration  in  Walter*s  * 

*  ■  *'  i 

h'turtle'^  since  the  latter  embodied  no  reinforcement  con-*  j 
icept.  However,  it  waa  obeerved  in  the  experiment  on  ttie  j 

general-purpose  computer*  ^ 

Lst  us  turn  to  the  problem  of  Bimuiation  of  b.he 

simpl-&  conditioned  reflex.  I 

Let  UB  place  a  receptor  neuron  of  the  automaton  ln-| 

I 

to  correspondence  with  each  external  stimulus  **  .1^^*  j 

I  The  problem  consists  In  the  following?  if.  on  the  | 

[appearance  of  the  stimulus  (the  receptor  neuron  ox  j 
the  automaton  is  excited),  the  automaton  responds  in  a 
random  ir^inner  with  the  action  a^,  and  the  sustenance  N  ap¬ 
pears,  and  this  occurs  several  times,  the  automaton  should  . 

' always  respond  to  the  appearance  of  the  stlmulua  with  j 

the  aotivttlea  a^.,  ! 

I^et  us  consider  the  diagram  of  Fig*  2*  This  diagraii., 

iwlll  be  referred  to  as  the  central-cell  diagram*  It  has  j 
three  inputs  and  an  output.  The  central  cel3/s  output  must  | 


168 


»>v»w«fc.»i,..!nu8K<f!^'V^b<«6w»:B>>«w>^<fap^.’«'K>f>^  r’a»»mv4<ca»ii>&8W»~  sy^Wa.- '  j»w«i ;  iaH«*y  .wwwigtfiii*;**-  :, 

'!  ■  ■  S 

/be  excited  and  remain  excited  when  all  three. inputs  have  | 

I  •  '  '  f 

ibee^n  excited  simultaneously  a  certain  niunber  (usually  ran-  | 

fdom)  of  times » 

t  The  stimulus  -of  the  receptor  neuron  I,,,  is  tr-ans-  [ 

!  ■  i 

piiltted  to  the  input  and  tliat  of  the  effector  neuron  to  I 


I  the  input  a^;  appearance  of 'the  sustenance  exoites  the  in-  j 

I  put  N.,  If  all  three  inpiits  are  excited.^  the  neuron  whioh  | 

1  '  I 

has  a  threshold  of  2,  and  the  neuron  Q.,  which  also  has  a  I 

threshoD.d  of  are  excited,  Tbie  excitation  from  the  neuron 

■? 

Qi  is  transmitted  to  tho  input  of  the  excitation  accu^nulatorl 


Pig,  2.  Central  cell,  I 

I 

I 

Like  all  other  neiu’cns  the  acciomulator  R  is  also  I 

i  I 

pharacteriaed 'by  the  accumulator  threshold.  However ^  this  ^  j 
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ithreshold  is  a  raridora  valiie  which  depend b  on  the  number  of  j 
iforegoing  excitations.^'  on  temperatur-e^  etc«  J 

I  When  the  number  of  Btlmull  exceeds  this  thresholdf  ; 

»  ^ 

(the  accumulator's  oistput  is  excited.  The  accuBiulator  axon  ? 


!na;s  a 


terminal  plate  which  Is  a,pplled  to  the  body  of  the 


i 


hieuron  n,  which  has  a  threshold  I. 

I  ■ 

I  '  Ihe  neuron  L  la  excited,  and  due  to  the  feedback 

[loop,  it  remaina  excited.  In  addition  to  this,  an  Inhihltcry] 
'!  tei'mlnal  plate  is  applied  to  the  neuron  Ii,  Once  having  been.; 

5 

! excited,  thax'efore,  the  neuron  1/  remains  exclued  until  the 

! 

{inhibitory  plate  Is  excited.  The  reflex  is  developed.  Now  i 

I  ^ 

I  when  the  receptor  neuron  is  excited,  the  neuron  • 
has  a  thy/eshold  of  2  (one  of  its  plates,  which  is  on  the 
axon  of  the  neuron  L,  1b  excited  at  all  tiiriss)  and  is  con- 
i  nected  to  the  effector  neuron  a.^  Is  Btlmulated, 

I  Therefore  vfhen  the  stlrculvis  I  acts  on  the  a'utoniS;t{|: 

Liu  will' always  respond  with  the  activity’-  a  . 

f  '  r 


I 


I  If,  when  this  is  done,  the  automaton  does  not -re-  ; 

I  '  ■  '  I 

I  calve  the  sustenance  from  the  environment,  a  Btlmulii.a  fr'cin; 

1 

!  the  nsnxcon  P  enters  the  stimulus  counter  S  through  the  I 


\  neuron 


M«,  Tlie  stlmulvis  countar  also ’has  a  definite  thresh 


[oldh  If  the  situation  recurs  several  tlirses  (the  automaton 


I  does  not  obtain  sustenance  in  response  to  the  activity  a^). 


|the  number  of  stimuli  will  exceed  the  threshold  of  the 

L 


luoKKa-Attt^i,  aiftnuunot 


ptimlation  ccunter  S^,  the  counters  axon  and,  consequently,! 
(its  Inhibitory  terminal ■ plate,  which  is  applied  to  tne  tody  ! 
;0f’  the  neur'on  L,  will  be  excited.  The  refl«rx’is  quenched. 

i 

If,  however,  the  sustenance  is  received,  then  the  [ 
neuron  Q,  vjhose  axon  is  coimeeted  to  tiu^ow  ■  the  stimulus  | 

’ counuer,  is  Btimulated,  The  stimulus  counter  returna  to  its' 
'Initla]  state.  The  reflex  1b  reinforced  and  not  quenched^  f 


It  is  therefore  possihle  to  simulate  a  condltior 


nea  | 


i  reflex  by  means  of  such  a  scheme.  Hot'^ever,  the  raedlwa  Is  ^ 

'i  ■■■■■:? 

I  characterized  by  a  certain  set  of  stimuli.  The  automaton  is; 

»  'i 

3  .«  ■  ^ 

.likewise  characterised  by  a  certain  set  of  reactions.  It  lei 

I 

,reccsBary  to  enable  the  automaton  to  work  out  any  condl-“  I 

'  I 

fulonod  reflex  (any  reaction  to  any  stimulus)  This  point  f 

t  ”  ^  '*  ^  I 

i  refer  here  to  any  of  the  reactions  possible  for  the  ,  ,  I 

^  1 

i  airfcomaton,  and  to  any  stimulus  sensed,  ; 

!  . .  .  I 

f  ha.B  not  be:en  observed  in  any  of  the  attempts  to  simulate  i 
I  the  learning  process.  For  this  reason,  as  Kossa  co.mments  I 

I  I 

I  cox-».rectly  j.n  his  book  entitled  ''Cybernetics’'  /35/>  the  ! 

I  i 

I  "turtle's ’*  reflex  was  predetermined.  Tixe  automiaton  HTuet  have' 

!  ‘  4 

j  "freedom  to  learn",  the  opportunity  to  select  the  I 

}  {■ 

inecesBarpr  association  from  the  set  of  admlselble  assocla™  .I 


:  tions 


To  solve  this  problem,  let  us  construct  a  matrix 


p  X  n  of  central  cells  (Fig,  3)*  Each  row  of  the  matrix  isi 
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Ir-alated  to  a  definite  effector  neuron  (i»e.,  a  signal  wlilc]ri| 
[stlmulateis  the  corresponcling  effector,  neuron  la  dellvere| 

I  ■  ^ 

to  the  input  a,  of  each  central  .'csll  forming  the  row  of  ' the  i 
■  ^ 
|matrdx)«  •  .  | 

F  ■  i 

I  Bach  column  of  the  matrix  is  as.soclated  with  a  def~| 

Is 
inlte  receptor'  neuron.  In  aMition  to  thiSj,  a  sustejiance 

signal  Is  delivered  to  all  central  cells  of  the  iiiatrtx,  ^ 

■  ■  ■  ■  t 

If  now>  for  example^  the  receptor  neux^on,  is  ex~  | 
cltedif  the,  automaton  responds  with  the  actio.n.  and  the  | 
sustenance  N  is  oDtalned,  then  all  ttiree  iripute  will  be 
stimulated  only  at  the  central  cell  lying  at  the  InterseC’-  | 
tlori  of  the  column  and  the  row.  Only  two  or  one  of  I 

S 

*  ■  I 

the  incuts  of  all  other  cells  will  be  stimulated.  If  the  ,f 
•  ■"  t 

coincidence  is  repeated  several  tlmeSj  then  the  neu'ron  L  is  j 

stimulated  in  this  particular  centi*al.  cell  and  connects  thej' 

I  axon  of  the  stimulus  with  the  body  of  the  s  t  effector  | 

neuT'cn  through  the  neuron  P,  Thus  we  may  develop  any  of  thJ 

I 

m  X  n  possible  conditioned  reflexes,  | 

.  I 

For  ttse  reflex  to  be  developed  It  is  necessary  that! 

' 

the  autor.®ton  somehow  act  on  the  medium  in  which  it  is  stt-| 
uatec,  I‘or  this  purpose  the  automatoTj.  has  a  randoEi,“*&xtlvits( 

“  *  '  I 

block  which  stlismlates  the  effedtox’  neurons  eciuiprobably,  | 

Wlieri  the  automaton  Ms  learned,  the  ‘randoffi-aotivlty  block  | 

I 

I is  disconnected  and  the  automaton  responds  in  a  definite  'i 
I  manner  to  e.xt'ernal  stimuli.  _ _ _ 
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f  c)  The  Problen  of  Differentiation  f 

i  '  ‘  '  ! 

I  of  Tima  Hepresentatlons  I 

i  We  have  constructed  the  Bcheme  of  an  automaton  which 

t  ■  ■  '  f 

iclmiulates  the  development  of  a  nimple  eonditioned  .reflex*  \ 

\  ■'  5 

i  ■  •  • 

jf.et  na  paPS  now  to  the  complex  conditiojied  reflex 

jpose  the  a'^tomaton  m'ast  deve^lop  the  chain  of  i‘eflexes 


re  a  ,  gup  ~ 


Xrj~8  5— 'Tt  “"^h  ""f  c  ""W » 


4 
i 

'  "i 

i  '  i 

I  Tlien  N  will  be  the  reinforcing  factor  for  the  as3o-”| 

!  I 

fetation  Ip-a.,  ^  Ip  will  be  this  lector  for  the  assoolation  : 

515  j 

,  and  N  will  be  this  factor  for  ^  Ip «  Since  th,e| 

‘anto.naton  is  learning  process  proceads  fcaclcvyard^  the  rein-  |’ 

,1 

(.for'-iing  factoT’  for  this  rcjflex  will  be  formed  by  all  stirauili. 
,  ‘ 

•f  .  : 

‘for  v'hlcli  i^efle:-:  rasi3onses  liave  been  developed  prevloirsly*  ;! 


Consequentlj'-j,  \<.;e  are  confronted  with  the  p.rcblem  of  '  i 

:  } 

'I  I 

f  tlng'uj.  6h.ing  Btinnill  for  which  refla.xea  have  been  worked  ontL 

it  ' 

!  The  term  tlino  differentiation  I0  used  in  the  fol-  | 

1  •  .  r 

flowing  sense:  11  some  central  cell  (Pig*  3)  has  been  elmti-'l 


jlated  in  the  k  '  ‘  coltirmi,  then  t'ie  stlmulnt  I,_  Bho'ulcl  becomtei 


k  ' 


ta  reinforcing  .factor  for  all  the  remaining  colurnns..  If.,  i 

I  ,  ■  I' 

•j-  vt  i 

|further.y  some  cell  Ims  been  stimulated  in  the  s''  '  columiii  i 

t  .  .  '  i 

f  .  1 

ithen  the  stimuli?©  should  become  a  reinforcing  factor  for? 

\  ”  .{-V-,  ■  I 

|a].l  other  coluimis  with  the  exception  of  the  k  \  | 

i 

!  The  problem,  of  time  differentiation  reduces  to  the  i? 

I  ’  P 

Ifollowing:  there  exists  a  certain  filament  whose  coixd til 
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f  .  ■ 

litT  in  the  "all  or  notliirig"  aen^e  contirolB  a  certain  Bchemel 

i  '^  ■  ? 

I  i 

'•with  the  numbered  Inputs  1  and  2.  If  the  input  1  of  thlB 
«  • 

I  ‘ 

Ischeme  has  been  stimulated  earlier  than  input  2,  then  the 

f  '  ' 

f filament  eond*acts  irrespective  of  whether  input  2  is  then  [ 

i  ‘  ■  i 

iex-oited  or  not.  If«  on  the  other  handj,  input  2  is  stimulated 

i  ^  ^ 

I  earlier,  the  wire  will  not  conduct' regai’dless  of  whether  in--: 
put  1  is  stlirralated^, 

I^t  us  consider  the  diagram  of  Fig.  h,.  A.  neiue  filar 
merit,  whose  condvictlvity  must  be  variable,,  fovim  the  cha:ln  ,3 

i 

into  which  the  two  neurons  P  and  Q  are  connected.  In  ] 

1 

its  initial  state j,  this  circuit  does  not  condu.ct  stii'ftull,  !#■ 

J 

,1 

since  the  neuron  Q,  has  a  threshold  of  2.  If  the  input  1  is  | 

now  etimulated^  the  chain  3-4  will  conduct^  since  one  of  | 

I 

the  exciting  plates  at  the  neuron  Q.  has  bean  stimulated*  i 

'Further,  when  the  Input  2  is  Btlmulatecl  the  clialn  S-e-  will  | 

conduct t  since  the  inhlt'itory  pla'ce  at  the  neuron  L  is  | 

stimulated  and  the  neuron  will  not  be  able  to  e-ntar  the  ex*| 

cited,  state «  On  the  anpearance  of  a  stimulus  at  the  input  | 

I 

3.  therefore,  the  neuron  P  is  etliiiulated#  and  then  the  neu"| 
ron  Q,  which  already  has  one  plate  stlmuXated  (threshold  2|, 
and  the  excitation  proceeds  down  the  cha,in  3--'+  In  this  mn-i; 


Let  UB  consider  a  case  in  which  the  input  2  is  gtlmu- 
Lated  first.  Then  the  ne-uron  L  w.111  be  excited, and  self- 
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Pig.  3* 

Ranjiom-activlty  block;  2)  effector  neurons;  3)  receptor 


I  Pig.  4^  Illustrating  the  problem  of .  timp , 
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locked  by  tlie  feedback  loop.  The  inhibiting  plate  at  the 
[neuron  P  will  be  excited  and  the  chain  3-4  will  be  noncon- 
sd'acti-^/e*  The  neuron  L  has  two  ..excited  exciting  plates^  and. 
[will  not  be  inhibited  by  etijaulatlon  of  the  input  I. 

;  H'iub  we  may  solve  the  problem  of  tj.nie  differentiation 
!of  stimuli. 


i  dl  Formal  Scheme  of  Automaton  < 

i  .  '  ■  i 

i  I 

I  For  the  autoiriaton  to  be  able  to  develop  conditioned-re-' 
I  ■  .... 

flex  chains  (a  program  of  activity j>  it  Is  necessary  to  j 

I 

combine  the  network  for  the  development  of  sirr.ple  condl-  | 

i 

tloiried  reflexes  with  the;  network  for  time  differentiation  .’i 

'I 

S 

I  of  stimuli.  Let  us  consider  the  complete  dlagrtua  of  the  | 
j  automaton,  | 

i  Let  us  set  up  Epeclal  reinforcement  buses-  fox*  each  col-| 

I  ^ 

iumn  an,d  connect  them  through  a  scheme  Blmilar  to  that  ahowjt 
i  -  I 

I  in  Pig, -4  with  each  stiM.jlus  with  the  exception  of  the?  | 

istlciul'us  of  the  coliomn  in  question.  Figure  5  shows  this  1 

1  '  I 

j  connection  .for  the  column  L.  ,  Ihe  terminal  plates  of  the 

i  f 

1  axons  of  all  M  central  cells  (their  L  neurons.,  see  Fig.  2)  I 

i  '  t 

?of  the  column,  are  applied  to  the  body  of  the  neuron  | 

I  I 

I  The  teiXfiinFil  pdates  of  the  central  cells  of  columns  I.,,,,! 

I  1 

I 'were  axjplled  to  the  body  of  the  neurons  reapee-  | 

tively,  ThuEi  It  is  evident  that  all  stimuli  for  which  con-  I 


J. - 


v-W5*far‘  «.oer<«w-*3B&<*««i^ 


'vV" 


f«, 

Wf 

V 

■  «■!" 


1 
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!  ^''  >•' 

I  Pig,  5»  Time-differentiation  network 

!l)  Reinforcement  bus  of  column  I,  j  2)  from  eolimiri  I,j  3) 
I  -K  .'  k;  ■" 

jfrom  column  I.;  4)  from  column  ;  5)  f3?om  column  I  , 

\  X  ■  X  rn 
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fditloned  reflex  peactiona  "were  develop-ed  before  an^*""  were  def 

ivslopad  for  the  Etlmuliia  will  become  rein, forcing  factors* 

i  '  ■  f 

(for  the  conditioned  responee  to  the  stimulus  T‘:ho.S€  stim- 

iuli  for  which  reflex' responses  were  developed  after  the  re". 

I-  '■••*'  ■  '  i 

?spoBse  to  the  stiimilue  I.,  will  no  longer  be  reinforcing  facf- 
tors  for  the  response  to  Hiis  occurs  as  a  result  pf  the.; 


Xt 


cperation  of  the  system  based  on  the  neurons 

which  we  have  al.t*eady  considered  (Fig,  4)«.  1 

Thus  MO  have' used  fo^raial  neurons  to  construct  an  j 

autowiaton  circuit  which  aimtilates  the  deirelopment  'of  -a  con-«f 

{ 

dltioned-refler,  chain.  The  over-all  block  diagram,  is  shown  | 
in  Fig,r  6,  Tl.ie  work  of  its  individual  blocks  has  already  | 

I 

b-?en  .described.,  | 

The  basic  bloc'ka  of  the  automaton  are  the  mtrix  off 
Ri  X  n  central  cells^  n  of  the  Bchemei’S  prec-ented  in  Fig.  5> 

I  and  a  random-'-actlvity  generator  block. 

f 

In  the  baglmilngj,  when  the  automaton  has  not  learned 

f 

it  dlsti,irbs  the  envlronii'tent  at  random  as  a  result  of  the’  I 

I 

r 

work  of  the  random-activity  generator,  xn  tuivij,  the  envlrorf- 
ment  reacts  in  some  way  on  the  automaton  by  exciting  its 


receptor  neurons  /£j  , 


n 


If  a  random  coincidence  of  some  stimulus  with 
activity  a  results  in  the  appearance  of  the  reinforcing 
factor  N>  and ' this' occurs  several  times^  the  association 


muMifesoL 
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?»?  «'>  .■«.  ;■  ’  ■  ; 


in  the  au-toKiaton  between  the  stirsulnts  and  the  activity  aJ 

B  ./i 

i 

is  strengthened  (the  central  cell  at  the  intersection  of  t:hej 
column  and  the  row  le;  excited)^  and  the  automaton 

I  I 

jhanGeforth  responds  to  the  appearajice  of  the  stlmuluE  1'^  | 

[ivTlth  the  action  If  this  reflex  is  not  I'einforcsd  'by  the  | 

\  ': 

|stlffiul\,m  N  It  is  eA?'entually  quenched,.  In  aiddltion  to  the  ese 

I' 

ItabllBhrinent  of  the  association  'betwec-n  activity  and  stlmul.ul; 

i  ' 

(the  stlmulUB  I,  becomes  a  reinforcing  factor  for  subsequent « 

■  B  * 

I  * 

b-eflexes,  Q'his  occurs  as  a  result  of  the  operation  of  the  I 

I  o' 

|tiirie--dlfforentlation  schemes  »h.  :1 

!i  ■  ■  •  I, 

^  ■ 

i  iliis  cont.lnne'S  until  the  reflex  chain  has  been  de-  j, 

jveloped  to  the  end.  At  this  point  the  autorftaton  is  fully  | 

'C-'2 ivemined,  it  performs  a  definite  activity  in  re-  | 

’  '  I 

lEponse  to  a,  definite  stiBiulus,  ,  I 

! 

I  If  the  external  conditions  have  changed,  the  auto-^ 

pat  ceases  to  obtain  sustenance  as  a  result  of  its  actlvi-  | ■ 

.  b 

itleo  and  proceeds  to  study.  Then  learning  begins  under  the  I 
blew  e.xter*nal  conditions  in  the  Bame  manner  as  described  I 

I  '  i 

f  ,  . 

;above,  f 

1  I 

\  Tliore  is  a  marked  over-design  in  the  structure  of  | 

i  ‘  I 

|bh9  automaton  the  matrix  consists  of  m  x  n  central  cell8, J 
I’.'-ut  when  the  automaton  has  finished  learning,  only  m  (or  n )  i 
'.ells  participate  in  the  work.  This  excess  i,s  otviouBly  | 


lieccBsary  to  escape  the  determinism  which  is  characteristic  I 
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I  Fig,  6,  Block  diagram  o?  automaton., 

hi)  Random-aetivlty  Block j  2)  effector  neiirons;  3) 
I  neurons. 


of  the  ’’conditioned  reflex” 


of  the  ’’turtle 


receptor 


The  block  diagram  of  the  automaton  shown  .in  Fi,g,  6  ‘ 

I  '  t 

lis  somewhat  simplified  by  comparison  with  the  scheme  of  th€| 


k 

actual  automaton,  but  the  two  arrangements  are  similar  In  | 
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l•’■■.A  .•"•■  .  ■'V-'- 


ipr'inciple,  ■  •  '  I 

f  ^  .  ■  I 

i  ! 

I  Tlie  system  of  the  automaton  may  do  still  further'  ; 

^complicated  so  that  it  v/lll  prodiice  a  ’'refier”  not  to  a  ; 

*  ■  .  I 

I  single  stimulus  j  but  to  a  certain  combination  of  them,  How**f 

^  ■  ■  i 

lever^.  this  would  only  result  in  puantltative  complication  ? 

\  * 
f  '  'i 

I of  the  scteme  of  the  automaton^  n 

I  '  ' 

I  Let  U3  consider  a  siibset  of  the  set  of  stimuli,  ¥e  I 

i  i 

s  shall  denote  the  absence  of  a  stimulus  by  '’0",  | 


0.*  Ig-i  ^  *■ 


subset  1  (vacant); 
subset  2| 
subset  3; 


<»  «>  4-  ^ 


V  «  y»  *  le  4 


00  ,  ,  ,  ^ 
xl 

,  ,  ,  0 


4  4  ♦ 


h>^2  •  •  •  I, 


subset  n; 
subset  n  ^  1; 


V  «  4  9  ♦  'O  V' 


subset  2  , 


I  There  are  a  total  of  2  subsets  in  this  set.  Let  us| 

i 

place-  a  receptor  ne'oron  of  the  automaton  in  correspondence  | 

I 

with  each  subset.  Upon  excitation  of  a  given  subset  of  the  1 
automaton's  inputs,  this  and  only  this  neuron  should  be  ex4 


icited 


I 

Here  we  deal  again  with  the  activities  of  -the  auto-i 


tnatonj,  and  set  a  certajui  subset  of  activities  into  correS'" 

i  '  w  Jli 


effector  neurons^  The  matrix  of  the  artomaton  Is  enlar^ged  - 
accordingly!  It  -will  contain  2^  x  2®  central  cellis.,.  ^ 

?  On  the  who  Is an  automaton  oorj^'ilicated,  in  this  man-*. 

f 

f  ■  ■  ,  ^  i 

[nor  will  be  more  general  in  nature ^  it  will  be  capable 

I  .  { 

lof  clevelopixig  rsflexeB  not  only  to  isolated  stimuli- but  als<|‘' 

i  -  •  ’ 

i  ]: 

ito  a  complax  of  stimuli, . This  stimulus  complex  will  be  sent, 

*'  i 

jhy  the  automaton  as  some  sort  of  whole  which  differs  from 

f  '  •  ; 

i 

ithe  simple  sum  of  the  Btlnrali*  I 


e)  Certain  ElectJ’toal  Circuits  of  the  Axitoraaton  | 

j 

Let  UB  now  consider  certain  electrical  circuits  of  I 

I 

an  existing  "learning'*  automaton,  | 

I 

The  .automaton  was  bxillt  at  t.he  Moscow  Power  Engin-*  | 

eerlng  Institute  by  tlie  studcmt  design  office  for  cyber-’  | 

} 

iietlcS;^  v^hic.h  Is  under  the  guidance  of  yu»N,  Kusheler-'W-  J 

f  . .  ’  . .  ■■  ■  \ 

Yaynshteyn,  T,  Borodnyuk^  E.,  Letskiy^  I,  GlagoleVji  E,  ; 

■ 

[ES-t gauzy  and  o this rs  took  part  .in  the  design  of  tlie  automatop, 

I  ■ 

i  Ba.slcally,  the  block  diagram  of  the  automaton  is 

f  ■  “  ■  ^ 

Icongruent  vjlth  the  block  diagram  constructed  from  the  formap, 

.  I 

neuronr:;,  hut  somewhat  more,  complicated  in  certain  da  tails,  j 

1 

Thu.s,^  for  .example^  •  a  system  was  introduced  to  prevent  the  i 

i  f 

!  ■- 

bxe-oution  of  two  actions  at  once,  i 

I  ■  i 

I  Tlie  autoniaton  responds  to  foxir  ©xteinial  stimuli,  | 

! 

■jlke  stimiill  are  stlarala'ted  by  pressing  special  buttons  on  | 
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h:-he  atitomAtor' *  Tlie ,  a-utoBiaton  can  ''perfor'iii”  three  activltieai 


i 


l^hlch  are  Bianife'sted  in  the  lighting  of  one  of  three  lamps*  ; 
[In  additioiij  the?  automaton  has  tliree  other  special  b-uttons,  • 

ipressnre  on  -which  simulates  the  appearance  of  'bl'ie  reinforc-' 

^  I 

■  -  '  \ 

ilng  factor..  I 

^  s 

i  The  operative  who  pushes  the  buttons  on  the  automa-J 

iton  takes  the  role  of  the  environment  In  the  learning  pro-  i 


jcess*  The  untaught  automaton  performs  random  activities;^  | 

I  "  .  i 

|i,e.^  switches  t.he  lamps  on  and  off  at  rando3-ft»  The  automaton 

i 

-  i 

I'uses  an  original  circuit  in  the  random  signal  generatori  | 

1  ,  i 

I  this  clrc-uit  employs  the  natural  Instability;-  of  operation  | 
(of  certain  tube  oscillators*  The  circuit  was  proposed  by  I 

!  •  ■  i 

^G,  '/aynshteyn*  f 


!  o 


Wa  shall  not  consider  the  entire  schemiatic  diagram.  ? 

1 

f  the  automaton  at  this  point,  V/e  shall  co'nslder  only  the  [ 


jekrcuits  of  the  centx»al  cells  and  the  tlme-dlfferentlation  s  , 

i  ■  I 

j network*  ■ 

i  '  ? 

i.  The  schematic  diagram  of  the  central  cells  is  pre-  1 

I  I 

fsented  in  Pig*  7-  As  we  see  on  examinatio-n  of  the  circuits  | 

!  ■  1 
■p.n  Fig.  2  and  Fig.  7?  the  neurons  P  and.  Q  are  realized  by  | 

i  1 

jthe  coincidence  circuits  D.  and  respect 

iThe  accumulator  B,  and  the  neuron  L  are  embodied  In  the 


;ivei|f . 

i 


jcapacitance  C^,  which  is  charged  from  the  voltage  divider 
QRg  through  the  resistance  when  the  diode  sov'itch  is 
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•  1)  Volts  ir  2)  T,  j  3)  diodes;  4)  polarised  relay., 

cpen^,  and  the  thjrr’atron  llie  feefibaclc  loop  of  the  neuro 
L  is  clearly  not  a  part  of  the  cix'cultj,  but  the  thyraton 
Itself  behaves  similarly  to  the  neuron  with  feedback  loop^ 
since  once  harj.ng  been  Ignited,  it  will  not  be  quenched  as 
long  as  the  plate  voltate  is  applied.  The  thj/ratron  plat 


circuit  contains  the  relay  PKl,  whose  contacts  form  the 
neurons  M  and  F.’The  excitation  counter  S  is  an  ordlnaxy 
trigger  counter  whose  counting  Input  is  connected,  to  the 
coincidence  circuit  clearing  input  to  the 

coincidence  circuit  I>gDj,Ry,  The  polarised  relay  RF^  is 
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placed  In  the  plates  of  the  last  tx^iggep  of  the  counter  with 
llts  contact  In  the  plate  circuit  of  the  thyratron.  The  ^ 

P  ■  ‘ 

^polarized  relay  Is  adjusted  In  such  a  way  that  when  the 
{, 

? counter  is  driven^  the  relay  contact  in  the  tn3''ratron  cli."*-  | 

f. 

cuit  le  closed.  ,  • 

j  Let  us  describe  she ■ operation  of  the  circuit  in  ^ 

f  '  '  '  '  ? 

;  brief,  ■  ■  I 

;  The  lamp  that  slmulatas  the  activity  of  the  autornah 

I  ton  is  lighted  from  the  randOin-actlvtty  block  and  bimis  foij 

S  about  five  seconds.  Jiurlng  this  time,  a  high  voltage  ap-  ; 

I  ,  ■( 

^  proximately  equal  co  the  plate-suppljr  .voltage  appears  at  | 

! the  input  1  of  the  coincidence  circuit.  When  a  Btiffiulus  | 

S  ■  '  I 

huttoi-;  is  pressed,  a  ttnlvibrator  which  gives  a  pulse  appi-^oxi 
:  '  ■  'I' 

[:in-ately  5*1l0  seconds  in  duration  is  triggered.  This  pulse  t 

I  is  fed  to  input  2.  If  the  activity  and  stimulus  pulses  cO' 

j inclde  in  time,  the  high  voltage  also  appears  at  point  4. 

i  Tf  now  a  oulse  is  also  delivered  to  input  3,^  the  Beconct 

t  ■ 

i 

j  coincidence  circuit  (the  neuron  Q)  also  operates. 


and  the  high  voltage  appears  at 


ty 


opening;  the  diode 


i 

switch  Dr u  The  capacitance  C,  begins  to  charge f  The  charg  - f 
0  f 

ing  time  constant  of  the  capacitance  is  basically  deter-  \ 

i 

nairied  by  the  siwe  of  the  resistance  R.-  and  the  capacitance j 

i  i 

iC-^,  Tte  voltage  to  which  it  is  ctoged  depend©  on  the  dura-| 
jtion  of  the  pxalse.  The  ’  capacitance  Is  eonne.cted  to  the  gri(| 


I 


jof  th-2  thyratron  so  that  when  it  Is  charged  to  a  c®rtal|i 

i  I 

rvalue ,,  the  tliyratron  le  ignited*  'Ttils  vilIl  occur  If  the  oo~j 

«. 

i incidence  of  all  three  voltages  at  the  Input  1/  2*  and  3  re>- 

f  •  •• 

^curs  several  tliftes.  The  nuirther  of  coincidences  neceBBar-y  .  ! 

I  depends  on  the  frequency  with  which  they  follow  one  another|. 

I  \ 

hue  well  as  on  the  values  of 'the  resistances  Ro'R,■^R,.^  and.  the  * 
t  (  o  9 

I  quality  of  the  capacitor  Ignition  of  the  thyratron  Big-| 
inlfies  that  the  automaton  has  ”si0Korl2:ed''  the  relationship  ? 

i  ! 

ibet’ween  the  corresponding  stimulus  end  actiyity.  The  autom-} 

I  i 

atons  study  proc€?eds  in  the  laermer  desc3:’ibsd  in  the  dlscus-l 
,  Sion  of  Pig.  2*  Tlie  trigger  countei-r  counts  the  number  of  f 

I  f 

I u.nsi3 stained  stimuli  and.  when  there  are  more  than  foxir  (the  | 

i  ■  '! 

I  counter  counts  tip  to  four),  the  contact,' of  the  polarized  .j 

relay  in  the  thyratron  circuit  is  opened  and  the  thyratron  | 

f  « 

Igoes  oi3t*  ThuEjt  tlie  po  lari  zed-relay  contact  plays  the  part  | 
lof  the  inhibltlve  terminal  plate  applied  to  the  body  of  thd 

c  « 

tneur^on  L.,  i 


I  ThiS  3  X  4  matrix  of  the  automaton  (three  activitle4..i 

I  four  stimuli)  1®  constructed  from  twelve  such  circuits*  j 

Let  us  pass  now  to  consideration  of  the  time-dls-  | 

\  crimination  network  circuit,  which  can  also  be  termed  the  I 
i  I 

4  i 

f reinforcement  block'  (Pig.  8),  I 

I  The  neurons  5)  are  formed  by  t.he  re- f 

flays  and  the  contacts  of  the  relays  | 

1  __  _  __  _ _ _ _ _ _ _  .  ■■  - -  -  — ,  Iifiiwi  nr»^inii^ 
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in  the  plate  circuits  of  the  thyratrons!  of  the  ^ 
(central  cells.  Hie  contacts  of  these  relays  form  an  or  i 

I  „  • 

! circuit  from  each  of  the  columns.  ; 

j  The  contacts  of  the  relayB  Pj. . .Pjyf  which  are  de-  , 


[no ted  by 

K1  J-  »  .  .■lfi'|''yr 

1  r.  tJ 

[  ^  I  *  ’ " "  n 

ai  ).d  J.J-r'  ...  h 

J.- 

jlays  Pr. 

1 

P  PK' 

..  -^-11 

!  contacts 

.  ifere,  in  t: 

[contacts,  ifere,  in  this  circuity  the  feedback  loop  Is  clearl|/ 

defined  1  it  is  formed  by  the  contacts  of  the  relays 

which  hold  •automatically  when  they  opera i-e.  Ine  c.-^ntaots 

which  are  shown  open  on  the  diagram  are  normally  open  and  | 

'1 

vice' versa.  i 

The  neux'-otiS  T-,  -are  embodied  In  the  diodes  I 

■  I 

This  circuit  works  in  exactly  the  same  as  the  formal-  | 

noux''on  circuit  ■  described  earlier  (F-tg, .  b)«  | 

As  a  whole,,  the  automaton  is  an  electronic  computed 
containing  approximately  100  tubes  (including  power  supply!), 

eemlccnductor  diodes,,  and  electromechanical  relays.  j 

The  automaton  described  above  is  operational  and  l£j 
: on  exhibit  at  the  Sxposltion  of  Attainments  of  the  Popular  j 
lEsonoiry  of  tha  USSR.  | 


V5*we.y 
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f )  S’eatures  and  Possible  Applications 

of  the  "Learning  Automaton” 

Thus  ue  have  considered  the  cipcuit  of  a  ’'leannlng 
automaton".  VJhat,  if ,  anything^  new  does  it  introduce  into  j' 
aiiflulation  of  the  learning  proceast  1 

First  of  all,  this  automaton  provides  an  opportiinity 
for  simulation  of  the  conditioned  reflex.*  The  automaton  is! 


i  pages  3^-58 


capable  of  associating  any  of  the  motions  of  which  it  is  > 

capable  with  any  of  the  stimuli  tliat  it  senses.  This  possi4 

bility  was  not  embodied  In  the  models  created- earlier  (Ws.l~| 

i . 

[ter’B  turtle  and  others).  The  "centi’al-cell  lixatrlx”  is  whal| 

*  .  ,  I 

makes  this  possible  in  this  automaton.  | 

j 

Secondly,  the  automaton  generates  a  chain  of  re-  f 

1 

j  flexes  which  develop  in  tline  in  such  a  way  that  one  reflex  | 

ia  followed  by  another.  As  far  as  we  know,  systie-as  capable  | 

of ,  such' activity  had  not  been  created  previously,  Simulatlo|n 

of  the  development  of  a  reflex  chain  leads  to  solution  of  | 

the  problem  of  distinguishing  sequence  in  the  appearance  of 

1 

stimuli  (and  fixing  an  association  between  stimulus  and  ac-j 
ttvlty)  In  time.  ’  '  1 

P.tnally,  simulation  of  the  learning  procesa  in  the 
autoiimton  differs  radically  from  simulation  in  electronic 
i digital  computers.  The  difference  consist b  In  the  fact  tiiat 
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<v--.  .'X-4T4: 


jthe  Etorage  eleraeiits  are  conjoined  ■with,  logical  eleii.(eni--Sj  • 
[this  apparently  approximates-  the  singularities  of  the  bralu-i 
jstruct'are  in  a  certain  sense. 

I  llxe  p\.a.'‘poBe  of  ereatlrig  the  automaton  cescrihecl  her  ■- 

i'was  to  sliimlate  physiological  processes^,  but  it  may  also  ^ 
Uiayo  tcoiririical  a,ppl5-cationg»  An  iiiiportH'n.t  property  of  tne  v 

t  . 

i^autornaton  conststE  in  the  fact  that  by  "studying  its  en- 
jvironffient"  it  woi’ks  out  a  definite  prcgrSBi  of  activity  whlcj’: 

beads  bv  the  best  route  to  the  assigned  goal  under  the  spe~c 

■  ■  ■', 

S  •  -  ■  '  v 

Iclfic  conditions  prevailing  In  the  medium.  By  adapting  it  j 

f  ...  -  ' .  '  i 

jto  a  technological  process  concerning  which  little  is  know3:i|, 

'  I 

' there -fore-j.  it  will  by  itself  wo-Uk  out  the  optlmtun  program 
I  of  operation,  ^‘«lth  tbOi  q-aantlty  and  cniality  of  the  result-  ■ 


I  ing  p.rociuct  playing  the  role  of  the  "reinforcing  factor  „  | 

iLlttle-uinderscood.  processes  are  .frequently  encountered  in  j 

1  the  chemical  industry,  e-.g.,.  in  the  prorluc-cion  o;f  syxiihetio 

I  ■  ■ '  '  I 

1  rubber ,  'Oncler  the  supervision  of  Docent  Kr-'U-g  ax;  the  ^ 

1 .  I 

j  Moscow  Bower  Et^gineering  Institute,  research  is  being  con-  j 

^di->cted-  on  the  application  of  a  similar  ffLaohine  as  an  auto-  5 
i  '  -  '  -  I 

Smatic  dispatcher  in  the  production  of  rubber,  | 

I  '  .  i 

!  The  slm\3.1ation  of  the  learning  process  in  automatiq 

h  ■  ■  ,  ,  ■  .  ? 

bia''‘h'^nes  opon.8  uo  prospects  foi“  the  stucly  of  otnex'  problems^ 

I  "  .  4.  -  •  I 

I  In  particular,  re.solution  of  the  problem  of  learn-  | 

ling  in  the  automaton  is  of  value  for  the  creat5.on.  of  liow  | 

I  jui-ir.i-i-  -  Jill- TIM.- _i.iiirtiiiMirri-'W~  J*'  * 
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liiagnostic  mchlneE  which  operate  on  the  p3?inclple  of  the  f 

I  ■  '  '  ’  i 

|l€arning  auton^aton.  ,  '  | 

►  •  ■  . 

I  In  the  opinion  of  Academician  A.l*  Berg.j,  President  ' 

f  i, 

of  the  Scientific  Council  on  CybernetlcB^  and  President  of  f 

'  [ 

the  Aeademv  of  Medical  Cclencee  of  the  USSR  Acaderrilcian 

'  ■  t 

Bakulev^  the  creation  of  such  automatons  will  open  great  • 

^  I 

prospects.  | 

'  •  ■  ■  I 

In  addition  to  thls^  we  encotjinter  the  problem  of  | 

I 

the  poGElblllty  of  more  or  less  abstract  inasterj  of  a.  cer-  I 

I 

\ 

tain  clrcls  cf  objects  posse-SEing  common  properties^  the 

I 

problem  of  Identlfl cation  of  a  geometrical  or  auditory  Im-  | 
|age,  etc.  Tlie  solution  of  these  problems  cremates  a  p,rer’equi|" 
I  site  for  ujider-standlng  the  activity  of  the  bral2i  in  certainj 
I  of  Its  aspects.  Apart  from  thls^,  work  on  these  probleras 
I  will  promote  work  In  technology^  where  a  number  of  such 


IproblernB  arise.  However,  they  raa,,y  be  solved  much  niorci  rap- 

f  '  . 

‘idly  by  studying  the  brain  and  alritalatlng  its  f-unctions  in  | 
I automatons «  ^  I 


CONCLUSION 


Ihe  design  and  creation  of  a  '’'learning  automaton” 
lhas  been  of  value  In  the  study  of  two  basic  theoretical 
Iproblems  involving  scientific  analysis  of  the  operaticn  of 


rOTBTftat 
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I  The  first  problem  rnay  be  oharaeteriged  ag  the  study! 

i  '  ■  f 

jof  the  general  principles  of  operation  of  self ^organlring  f 

I  control  systems,  '  In  this  case  we  speak  of  analysis  of  the 

I  ' 

i  comrolex  Phenomenon,  \fhlch,  in  Its  general  form,  is  clxarac™  i 

I  '■  ^  ^  ? 

1  tended  by  the  fact  that  the  control  system  (the  brain), 

f  '  ' 

fusing  a  certain  series  of  aetiCfriS,  “investigates*'  Its  en- 

t  • 

I  vlronment  actively  “v/ith  the  purpose*'  of  obtaining^  the  ; 

[necessary  informe.tlohv  The  result  of  this  procesE  is  the  | 

detection  of  authentic  and  useful  information  on  the  basis  .j 

of  which  new  operating  programs  (nex\'  expedient  behavior  I 

•  ■'! 

patterns)  are  formed.  In  oha.racteri.zlrig  this  process  In  its 

general  form,  ;■?©  deliberately  avoid  the  uce  of  the  term  | 

''■Teaming'',  since  this  terra  has  recently  become  endov?ecI  | 

.with  highly  different  significances,  I 

The  creation  of  a  model  of  a  “learning  automaton"  j 

I 

confirmed  a  nujiiber  of  hypotheses  which  had  been  ad\'’anced  | 

f 

earlier- on  the  basis  of  physiological  experimants  and  con- f 

ii 

cerned  the  principles  and  the  •  mechanl Eras  of  the  bralrTa  -  | 

I 

:  opara,tlori,  and  revealed  the  erroneous  nature  of  certain  asf 
BUTaptlonB,  Together  -v/lth  this,  the  creation  of  the  autom-  \ 
aton  advanced  a  v?hole  series  of  'new  -problems  and  questions  ■ 

i 

which  Indicate  the  necessity  of  further  'Dhysiologlcal  in-  • 

'  .  I 

vestlgatlons  and  determine  the  direction  of  these  experi-  | 
rae.ntc*  '  I 
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The  qv'eation  as  to  the  conditions  under  wliich  a  I 

I  ■■  I 

given  algorithm  employed  by  .a  control  aye  ten  na:/  result  In  > 

■;the  formation  of  new  operating  programs  is  of  particular 

jinterestj  as  are  the  conditions  under  .  whl cii  its  use  may  | 

'prove  ineffective^  I 


I  Analysis  of  this  problem  points  up  the  necessity  of- 

I  finding  new  algorithms  which  riiay  jTove  optimum,  under  a  glve|i 

f  ? 


.set  of  conditions „  i 

i  '  '5 

\  '  ' 

I  The  second  nroblem  is  related  to  analysis  of  the  \ 

1  *  -  i 

hnecbanism.  of  operation  of  the  brain^  i.e,,  to  analysis  of  'i 

1 

the  structure  of  thie  nerve  networl:  of  the  brain  and  study  | 

. ! 

of  the  procesBes  that  unfold  in  this  .structure.  This  prob-- | 

■  I 

i  iem  becomes  par  fciciilarly  pressing  in  connecrion  \*flt.h  the  ‘  = 
I  I 

\  Investigation  of  cojiditloned-reflex  systems  vd'd-oh  indies te 

»  ■'  t 

\  tlie  existence  of  complex  operating  mechanisms  in  the  brainj 

I  .  'I 

!  I.n  this  connection^  we  encounter  the  problem  of  studying.  | 

I  ■  ^  ^  ! 

cl'e.'  phjrBj.ological  mechanisms  which  provide  for  the  seauen--  i 

I  '  i 

ij  dial  forxuation  of  complex  reflex  systems  on  the  basis  of.  | 

I  ! 

t  prccessing  of  exr-ernai  inforiiiation.  This  problein  cannot  be  \ 

r  ■ 

[roduoed  to  a  problem  of  the  mechanism  of  formation  of  a  | 


I  single  reflex  arc,  ,  | 

i  We  h8,ve  already  spoken  of  the  basic  principles  used 

/  i 

In  study  of  the  operating  mechanismB  of  the  brain  ( Chapter  | 

■  I 

Paragraph  4  of  the  pi“-esent  book).  The  development  of  tht| 


^kerve-rietwor'k:  ths-ory  as  applied  to  the  proh-lem  of  foi*m&tlon| 

|of  concH-tloned— I’eflex  ol'xalJfi®  and  the  I'eallsatlo-n  of  this  i 
.1  ■  ■  .  .  ■  ■ 
itheox'y  through  the  corxstructiori  of  an  autoxsiatoR  has-  as  yet  , 

^  .  '  .  'I 

I’beon  u.Tia'bie  to  resoXTo  tne  (jiiestloxi  as  to  the  structure  of  r 

ithe  nerys  networXr  functioning  In  the  ferain,  Howeyerj.  the 

[creation  of  the  automaton  had  iis^^ortant  valtxe  .for  the  study? 

i  .  •  »  '  ' 

lot  this  prohlem*  In  creating  the  automaton^  certain  generals 
jprlnclpleB  of  the  organlssatlon  and  work  of  nerve  networks  j 

■  I 

I of  this  type  were  worked  out*  '  { 


g  .  r 

I  X^.gether  with  this,  it  was  found  possible  to  create,? 

!  working  hypotliesea  concerning  the  piky Biological  meclmnisms  .| 
at  the  basts  of  formtlon  of  reflex  chains,  which  will  soin4' 

'  ,  it 

as  a  basis  for  new  physiological  experiments*  Further  -work  ! 
in  this  direction  will  permit  a  more  profound  approach  to-  | 
the  study  of  the  bi’aln’s  operation,-  | 

.i  i 

Vfc  have  been  able  In  the  present  vol’am.^  to  consider^ 

J 

only  a,  few  of  the  problems  which  form  the  subject  .matter  of 
neuro cybernetic E »  For  exa-spl®,  there  arises  an  iinportarit  • 
problem  that  may  be  characterised  a.0  study  of  the  ability  j 
of  the’  brat’n  to  analyse  co^iplex  external  events  (stimulus  f 

f 

complexes).  This  pz*oblem  is  intimately  related  to  the  prob~[ 


jlem  of  classification  of  complex  sets  of  signals*  The  num- j 
|ber  of  various  complex  stimuli  acting  on  the  nervous  systexjl 
iia  extremely  large.  As '’a  result,  it  appear®  that  complex  I 

I  •  ■  ^ 

I  .  _ _ _ _ _ 

^piiiw'jiwwi»»iwn.iij»»in»iiii  "iwiiu  . . .  mm,  uu  n  1  ■  bh 
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4 

jproceEges  of .  identification  of  coramon  components  in  the 
ivarloxiS  complexes  ane  carried  out  in  the  coarse  of  the 
Ibrain's  activity/  resulting  in  the  formation  of  a  unique 
Lysten  for  the  classification  of  complex.  Btlmull*.  Each  ne-w 

I 

jphenomonon  1b  sensed  on  the  haslB  of  detection  in  it  of 
|groupH  of  signals  which  are  already  known  to  t.he  animal* 
jlhese  phenotiena,  which  apply  very  closely  to  the  problem  of  | 

! concept  formation,  play  a  mjcr  role  In  orientation  to  new  j 

I  I 

situations.  A  ntunher  of  other.,  problems  also  occur*  i 

‘!i 

NeurocyberneticB  provides  a  new  approach  to  the 
Study  of  the  w/ork  of  the  brain.  In  speaking  of  the  value  ofj 
{cybernetics,  E.Ya.  Kol ‘man  writes  /3  V*  divine.*  .the 

work  of  our  brain  and  its  vei’y  thought,  to  obtain  ever-- 
greater  power  to  eliminate  the  disturbances  and  upheavals 
Iwhlch  arise  In  the  processes  of  life  ~  is  t.hiB  not  really 
ithe  high  purpose  the  attainment  of  which  is  being  appro.acl 
Iby  cybernetics  in  collaboration  with  biophysics,  blochem- 
jistry,  physics,  and  psychology? 

I  We  may  express  confidence  that  this  path  of  Inven 

itigation  cam  result  in  new  progress  In  the  fields  of  phys¬ 
iology'  and  medicine,  and  prove  to  be’  of  great  asBlatance  in 
the  solution  of  the- problem  of  complex  au’fcoifiatlon  of  Indus- 
Itrlal  proceBses* 
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